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PREFACE 


M r. Kandel’s study of Examinations and their Substitutes in 
the United States summarizes the history of a phase of the 
relationship between our higher and our secondary educa- 
tion which abounds in interest not only for the student of the field 
but for the lay reader. It is a chronicle of increasing cooperation, of 
mutual understanding, and, even moi-e pertinent, of growing recog- 
nition of the importance of the individual as the product of the Amer- 
ican educational process. 

A dozen years have passed since Dr. Henry S. Pritchett, then presi- 
dent of the Carnegie Foundation for the Advancement of Teaching, 
discussed in the Nineteenth Annual Report of the Foundation the 
direction of our educational progress. Dr. Pritchett pleaded therein 
for “an ideal of education which rests upon simplicity, sincei-ity, and 
thoroughness.” This ideal pertains to the quality of education. Now, 
it has been recognized that in improving the quality of education — 
an effort in which the Carnegie Foundation has for more than thirty 
years been concerned — the central problems are three in number: 
first, the setting up of generally accepted standards of achievement; 
secondly, the devising of methods of measuring this achievement and 
of holding pupils to performance; and thirdly, the introduction of such 
flexibility in educational offerings that each individual may receive the 
education from which he is able to derive the greatest benefit. The 
importance of these problems, and especially of their solution, has 
been repeatedly demonstrated in the study of the relation of second- 
ary and higher education in Pennsylvania, which, in cooperation with 
agencies in the state, the Carnegie Foundation has been conducting, 
under the direction of Mr. W. S. Learned, for nearly a decade. 

The Pennsylvania study has proceeded simultaneously with an- 
other and an even more far-reaching study, namely, the international 
examinations inquiry, conducted by the International Institute of 
Teachers College, Columbia University. Funds for both studies have 
come from Carnegie Corporation of New York in grants to and 
through the Carnegie Foundation for the Advancement of Teaching. 
For the mternational examinations inquiry, under the general direc- 
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tion of Dr. Paul Monroe, director of the Institute, two international 
conferences on examinations have been held in England: one at East- 
bourne in 1931, and the other at Folkestone in 1935. The results, both 
provisional and final, of the inquiry in the various countries repre- 
sented have been published in those lands; Mr. Kandel summarizes 
them briefly in the appendix to the present volume. From the reports 
prepared by the national committees one fact stands out with extraor- 
dinary clearness, namely: there is an astonishing similarity in some 
of the educational problems which many countries face. In the United 
States, because of the unique chai-acteristics of our educational organ- 
ization and administration, these problems have emerged earlier than 
in other countries, notably those now represented in the international 
examinations inquiry. As a result, the questions of individual differ- 
ences among pupils and the bearing of those differences upon exam- 
inations and their use, emerged the eailier in America. These matters 
began to be subjected to close educational scrutiny and research at 
least thirty years ago. To this scrutiny the Pennsylvania study will 
contribute greatly. 

In the text of the present Bulletin, Mr. Kandel presents an account 
of what has been done in American education respecting examina- 
tions, the employment of substitutes for their traditional types, and 
the adaptation of education to individual abilities. He lias written this 
account with the problems which confront other countries in mind. 
Although he indicates the similarities of these problems he recognizes 
and takes into account the differences that underlie the educational 
systems of the various nations of which he writes. Thus the Bulletin 
presents at once a summary, on the one hand, of what has transpired 
in the United States respecting examinations and their substitutes, 
and on the other, of the issues implied for the organization of educa- 
tion in general. These issues appear to be practically the same, the 
world over. Hence it is hoped that the discussion may have value in 
the resolution of these and similar issues, not alone in the United 
States but in other countries. 

The thanks of the Foundation are tendered to Carnegie Corpora- 
tion of New York for making possible not only the international ex- 
aminations inquiry but the preparation and publication of Mr. Kan- 
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del’s Bulletin; to President Frederick P. Keppel, of the Corporation, 
for the vision and the lively interest which brought to pass both these 
inquiries and the volume; and to Dr. Paul Monroe, director of the 
International Institute of Teachers College, Columbia University, for 
his talented guidance of the conferences. 

Waltek a. Jessup 

October, 1936 




INTRODUCTION 


T he present volume is one of a series of reports which are being pub- 
lished as the results of an international examinations inquiry, in 
which educators in a number of European countries and the United 
States have been cooperating for the past five yearsd The Inquiry was initi- 
ated by Carnegie Corporation of New York in 1931 and has been conducted 
undei’ the general supervision of Professor Paul Monroe, Director of the In- 
ternational Institute of Teachers College, Columbia University. The first 
conference on the subject was held at Eastbourne, England, and was attended 
by representatives from England, Prance, Germany, Scotland, Switzerland, 
and the United States. It was clear from the discussions at this Conference, 
which were published under the title Conjerence on Examinations, Eastboicme, 
England (New York, 1931), that the problem could only be investigated in 
the light of educational and social conditions prevailing in each country. A 
National Committee to undertake such investigations was accordingly or- 
ganized in each of the countries represented at the Conference. The Reports 
of these Committees and a Report of the Conference on Examinations, held 
at Folkestone, England, 1935, at which summaries of these reports were pre- 
sented and discussed, are now available and are referred to in the text. 

Since the problem was not new to the United States and has, indeed, been 
the subject of research for over a quarter of a century, another investigation 
was not considered necessary. The present report was, however, undertaken 
at the request of the Carnegie Corporation to present a unified account of 
the experience of the United States with examinations and their substitutes 
in the hope that it will be of service to educators in other countries in which 
the significance of the problem in its educational and social implications is 
just beginning to be recognized. 

To Dr. Prederick P. Keppel, President of the Carnegie Corporation, the 
author desires to express his obligation for the opportunity of preparing the 

^ The notion of an international htudy of examinations had been canvassed for .some years before 1031. 
The place and functions of examinations wei e discussed at the meeting of the New Education Fellow- 
ship at Locarno in 1927, and an international commission was appointed to study the subject m rela- 
tion to the needs of education. Poisons in t,ome twenty countries inteiested themselves in the matter. 
At the Elsinore conference, 1929, mateiials submitted by representatives wcie discussed. The Fellow- 
ship expiessed the intention of continuing its inquiry more actively bcfoie its confeience convened in 
Nice in 1932 The chief concern of the commission wa.s that the subject of examinations should be 
studied intei nationally. The Fellowship published a repoit in 1933 under the title Examinalions and 
ike TJ’iiy Out. 
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report. To Dr. Walter A. Jessup, President of the Carnegie Foundation for 
the Advancement of Teaching, the author is indebted for many hours of 
helpful discussion of the American scene. Finally, the author aclcnowledges 
his indebtedness to Professor Ben D. Wood of Columbia University, and to 
Dr. William S. Learned and Dr. Howard J. Savage for their kindness in 
reading the manuscript and for many helpful suggestions. 

To the following publishers the author is grateful for permission to quote 
from books published by them: Frederick A. Stokes Company (J. A. Spender, 
Through English Eyes, New York, 19S0); Methuen and Company, Ltd. 
(A. T. Godley, Li/rnFriroZn, London, 1920); Longmans, Green and Company 
(P. Sandiford, Educational Psychology, New York, 1928); The Macmillan 
Company (D. Starch, Educational Psychology, New York, 1920); and Harper 
and Brothers (R. M. Strang, Personal Pevelopment and Guidance %n College 
and Secondary School, New York, 1934). 

I. L. Kandkl 

New York 
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CHAPTER I 

THE PROBLEM OF EXAMINATIONS 
AND ITS SOCIAL SETTING 

T he world is passing through one of those critical periods of upheaval 
and unrest which inevitably presage profound and fundamental changes 
in educational theory and practice. That educational thought and, to a lesser 
extent, educational practice have already been affected by this unrest is clear 
to anyone familiar with the literature of education since the outbreak of the 
Great War.^ What form education will assume when it passes out of its 
present stage of transition in such matters as organization, curricula, and 
methods, is not equally clear. It is quite obvious, however, that, despite the 
variety of political and economic systems, the educational world is beset by 
a large number of common problems, not the least hnportant of which is the 
subject of the International Inquiry on Examinations and of the present 
volume. And yet the problem of examinations cannot be studied in isolation, 
nor can it be understood if approached solely from the point of view of tech- 
niques of evaluating achievement or of setting educational standards. The 
proceedings at the first Conference on Examinations,^ held at Eastbourne, 
England, in 1931, revealed that a somewhat complacent acceptance of the 
infallibility of the examination systems in some of the countries there repre- 
sented was the expression of a firm conviction in the soundness of the edu- 
cational organization and aims for which the examinations served as tests. 
As the national investigations, which were initiated as a result of the confer- 
ence, progressed in the succeeding four years, that complacency was some- 
what shaken. For the investigations, although limited in the main to a study 
of the reliability of the marking of examinations, have already transcended 
the purely technical aspects. Properly interpreted the investigations have 
probed the very roots of the educational systems considered. They have 
raised the problem of the validity of set patterns of culture or liberal educa- 
tion. They have revealed the existence of wide ranges of individual differ- 
ences not only among pupils but also among teachers and examiners. They 
have proved the prevalence of a great amount of educational maladjustment 
as shown by the percentage of so-called failm-es in examinations. Where ex- 
aminations have been used not merely as tests of achievements but for pur- 

1 See I. L. Kandel, Comparative Education (Boston, 1933); I. L Kandel, edr , Educational Yearbook 
of the International Institute of Teachers College, Columbia University (New York, 1925-); Lord 
Eustace Percy, edr.. Year Book of Education (London, 1932 -). 

2 See Gonfee-ence on Examinations (New York, 1931). 
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poses of selection, they have directed attention to the dangers of injuslice 
through the unreliability of existing systems of marking. And, finally, thei-e is 
implicit in the results of the investigations a recognition that more is needed 
than the type of examinations as administered up to the present to secure a 
complete picture of the abilities and qualities of those who are to be educated. 
In the crisis which particularly affects youth at present, and perhaps for all 
time, the evidence available from these studies indicates the necessity of dis- 
covering more than can be revealed by the traditional form of examinations, 
if a sound basis is to be found not merely for educational but for vocational 
guidance as well. For the changing civilization demands on the one hand an 
increase and extension of educational opportunities, and on the other the 
discovery of the right education for the right individual, and beyond this 
the urgency of devising methods by which there may be reduced the inten- 
sity of the current pressure to academic and liberal professions, a pressure 
which has already been fraught with danger to the stability of society.^ 

It is clear then, if one may judge from the results of the examinations up to 
the present, that a study of the problem of examinations strikes at the very 
roots of education, whether considered from the cultural or IVom Ihc social 
and political points of view. With one exception, the reports of the Scottish 
Committee, the investigations, although they have in the main not pro- 
gressed beyond proving the unreliability of marking examinations,- dolinitely 
point to the need of studying the question of the distribution and differentia- 
tion of education. This does not mean, as may be hastily assumed by some, 
that the traditional concepts of education and culture have failed; it docs 
mean that, since many pupils who have been exposed to it have not derived 
the benefits intended to be transmitted, new types of education, better suited 
to the abilities of the pupils, must be developed. And this is to-day becoming 
all the more urgent, since there is every indication that the nineteenth-cen- 
tury organization of education with one type of school for the masses and 
another for the few is about to be surrendered in favor of providing a wider 
range of facilities for more pupils in post-primary education. In view, then, 
of such extension upwards the problem of discovering the right education for 
the right individual is one that not merely concerns teachers and adminis- 

1 The reform of the organization of education at the secondary level in Italy was based on the lecog- 
nition of this danger; the unrest due to the overcrowding in the universities and consequently in the 
professions was without doubt a conhibutory factor to the Nazi Revolution, theie is in fact no country 
in Europe, with the exception of the Soviet Republics, in which this aspect of the educational problem 
IS not serious. 

^ See Sir Philip Haitog and E. C. Rhodes, An Examination of Examinations (London, 1935) and The 
MarLs of Examiners (London, 1936); Commission Fiangaise pour I’Enquete Carnegie, La Con ection 
des Epi euves Eentes dans les Examens (Pans, 1936). 
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trators but involves the happiness of individuals and the welfare of society. 

In offering in the present volume an account of what has been done on the 
subject of examinations in the United States, it is not intended to suggest 
either that a final answer has been found or that the American solution will 
apply to educational systems in other countries. The diseussions at the East- 
bourne Conference, which were not formally prepared in advance, brought 
out no more significant facts than the individuality of national cultures and 
consequently of their divergent educational problems.^ Despite these differ- 
ences, however, the fact that the subject of examinations has been studied 
in the United States for the past thirty years, that a considerable amount of 
experimentation has been conducted, and that educational practices have 
been profoundly affected by the results may have its contribution to make, 
if only from the point of view of method. On the other hand, educators in the 
United States may in turn profit from further developments on this problem 
abroad, for the European countries have on the whole clung more tena- 
ciously to educational traditions, have maintained a higher quality of stand- 
ards for the few, and have demanded greater thoroughness of achievement.^ 

Differences between European and American Education 

Before proceeding to the subject of this volume, then, it is important to 
discuss certain differences of background in the European countries and the 
United States in so far as they affect education, particularly since these dif- 
ferences have influenced the approach to the study of the problem of ex- 
aminations. 

The first obvious difference is that of organization. The European organ- 
ization of education has been and to a large extent still is dual in character — - 
an elementary system for the masses, which even though it may extend be- 
yond the elementary school proper is none the less distmet from the other 
system of secondary and higher education.^ Hence education above the pri- 
mary level has had to be protected by barriers in the form of qualifying or 

1 The importance of this point is fully revealed in the Educational Yearbook, 1929, of the International 
Institute of Teachers College, Columbia University, which dealt with “Philosophies underlying Na- 
tional Systems of Education” (New Yoik, 1930); see also I. L. Kandel, Comparative Education, Chap- 
teis I-IV (Boston, 1933). 

^ See W. S. Learned, The Quality of the Educational Pi ocess in the United States and Europe. Carnegie 
Foundation for the Advancement of Teaching, Bulletin No. 20 (New York, 1927). This excellent com- 
paiison of secondary and higher education in the United States and Europe is open to only one criti- 
cism: it fails to make any direct reference to the severely competitive character of European education 
with pressuie from the home and pressure for social status, incentives which aie on the whole not 
present in the American, scene. 

“ See for purposes of illustration the article on France m the Educational Yearbook, 1930, pp. 309 ff. 
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competitive examinations, a protection which is all the more severe, even 
though unconscious, partly to maintain the standards of quality and partly 
to limit the numbers that might ultimately enter the universities and the 
liberal professions^ Examinations accordingly serve a dual purpose; they are 
used both as tests of achievements and as methods of selection which become 
more intensive as the time of admission to the universities approaches. 

It is obvious, however, that the problem is assuming a new complexion as 
the old type of organization is beginning to be discarded and the common 
school idea is being introduced. The traditional academic secondary school 
is retained in this new scheme, but other types of schools for pupils above 
the primary stage are gradually beginning to be brought under the general 
classification of secondary. In the brief period since reforms of this type have 
been introduced no satisfactory methods of selection have yet been devised. 
The articulation between the primary and the secondary school proper may 
have been improved, although this is still doubtful, but the very increase in 
the number of pupils has only served to intensify the problem of selection 
and distribution.* It appears to be the general opinion that no satisfactory 
method of selection has yet been devised, whether by examinations or teach- 
ers’ judgments, whereby the future success of pupils in the traditional sec- 
ondary schools can be predicted at the present age of transfer.* So far as the 
organization of the educational ladder is concerned one of the crucial points 
is definitely at the stage where primary education closes and some form of 
post-primary education begins; the other is at the stage of admission to the 
universities. 

The educational system of the United States is built up on the vertical 
system, each stage of education being articulated with the next following, so 
that pupils pass normally on the completion of their elementary education 
into the high schools and thence into the college under certaiu conditions, or 

1 The part that the fear of lowering standards and of producing an intellectual proletariate has played 
m secondary education is well illustrated by the history of secondaiy education in Germany since the 
days of Bismarck; it was inherent in the struggle for the recognition of equivalents both m G ermany and 
France; it plays an important part in the conduct of examinations in some of the Latin American coun- 
tries (see the article on the Argentine Republic in the Educational Yearbook, 1930, pp. 1 ff.). The fear 
of an intellectual proletariate was responsible for the reorganization of secondary education in Italy 
which definitely represented an attempt to provide differentiated types of secondary schools and to 
deflect students from entrance to the universities by setting up additional bariieis to be overcome (see 
I. L. Kandel, Comparative Education, pp. 75T ff.). 

® See C. W. Valentine, The Reliahility of Examinations (London, 1932), and O. Bobertag, Schuleraus- 
lese (Berhn, 1935). One can only infer from current articles that the same situation holds in France, 
where no specific study has yet been made of the effect of the rapidly increasing enrollments m the 
lyc^es and colUges. 

s This takes place at ten years of age in Germany and Italy; at eleven plus m England, France, and the 
Scandinavian countries. 
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on tlie completion of the primary school into the junior high school, thence 
into the senior high school and from there into the college. There are no en- 
trance examinations barring the way into the high school, and, with few ex- 
ceptions, students pass from the high school into college under a system of ac- 
crediting or certification, provided that certain requirements have been com- 
pleted in the high school. There is a tendency to reduce the rigidity of these 
requirements particularly in the state-maintained institutions; and many in- 
stitutions which have hitherto admitted students on certificates obtained in 
examinations conducted by the College Entrance Examination Board (see 
pp. 43 ff. below) have recently agreed to admit students from thirty selected 
secondary schools, public and private, which have entered upon an eight-year 
experiment with the secondary school curriculum.^ 

The second outstanding difference is to be found in the curriculum of the 
secondary school. Despite changes which have taken place in the European 
secondary school curriculum since 1 890, chiefly in the recognition of the place 
of modern languages and sciences, the curriculum is still largely dominated, 
first, by the traditional concept of a liberal education with its strong emphasis 
on the study of languages, ancient or modern, and, secondly, by the fact that 
the secondary school is recognized essentially as preparatory to higher edu- 
cation. This is true even in England, although only about five per cent of the 
pupils who complete the secondary school course proceed to the universities 
and where considerable confusion has arisen through the virtual interchange- 
ability of the first secondary school certificate and the matriculation certifi- 
cate.^ What this means in practice in all countries® is that the schools are 
organized on the principle that the pupils must be fitted to the curriculum 
and not the curriculum to the pupils. If a pupil fails in the relevant examina- 
tions, then caveat alumnus; the standards at least have been maintained!^ 

^ See the Repants of the Commission on the Relation of School and College of the Piogressive Educa- 
tion Association. 

^ In June, 1933, the Northern Universities Joint Matriculation Board announced that these two cer- 
tificates would be kept distinct and that the changes would go into effect in 1938. This will probably 
mean the differentiation of courses or requirements for those who plan to take the school certificate 
examination or the matriculation examination. 

® No study has been made, except in Germany, of the number of pupils who leave school before com- 
pleting the secondary school course and qualifying for the certificate of admission to the universities. 
They simply leave with a truncated course 

^ Even on this point tlieie no longer exists the complacency which used to prevail. Complaints are made 
that standards are gradually falling with the inci easing numbers who continue to the end of the sec- 
ondary school and proceed to the universities. A statement to this effect was published in 1928 by the 
Faculty of Philosophy of the University of Berlin; M. Lapie, who at the time of his death was Recteur 
of the University of Pans, complained of the immaturity of students entering the university and sug- 
gested the introduction of a preparatory year. In Denmark a commission was appointed in 1933 to 
inquire into the same problem, — the lowering of standards consequent on increased numbers. 
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The absence (in the United States) of a rigid intellectual Iradilion explains 
many of the differences in educational theory and practices noticed by the 
European observer. While education in Europe is founded on a somewhat 
traditional and inflexible concept of culture and cultural values, the United 
States presents a certain cultural rootlessness, despite the criticisms of pro- 
gressive educators that the high school curriculum is dominaled by college 
entrance requirements. American culture has been the result of two conflict- 
ing forces — the frontier and the European tradition, and of these the first 
has on the whole been the stronger in the greater part of the country. ^ One 
result of this situation, and, to a certain extent, more intimate and direct 
control of education by the taxpaying public, has been a greater readiness to 
experiment with the curriculum at all levels and to adapt its ri'quii'oments to 
current social demands and to the needs and capacities of the individual pupil 
or student. There has thus been a tendency in the pa.st idiirly years, slow at 
first but increasing in momentum in the past decade, Lo discover course.s 
adapted to the needs, interests, and capacities of the individual, unlil Ihc 
only requirements that seem to survive are English and the social studies 
(history, politics, economics, current evenls).'^ The European principh* which 
may be stated as follows : “Find out what the pupil ought lo do and make him 
do it” seems Lo have been converted in the United Slales inlo: “Find out 
what the pupil can do, and allow him to do it.” This means a wider expan- 
sion of the curriculum than has ever been thought possible in the European 
schools, but it also means that methods have had lo be devised lo discover 
different types of abilities and aptitudes, and attempts have had to be made 
to provide such arrangement of courses as will enable a pupil Lo woi’k to the 
best of his capacities. ‘‘ 

1 The predominance of the frontier influence is illustrated in the statement, which is fiequently re- 
peated as a justification of the American educational scene, that “we aio a pioneer people.” 

“ See I. L. Kandel, History of Secondary Education, pp. 481 fP. (Boston, 1930). 

® A sympathetic interpretation of the American situation has been given by .T. A. Spender {Through 
English Eyes, pp. 227 f., New York, 1928) “The English academic who has been biought up on New- 
man’s ‘Idea of a University,’ feels a ceitam dreariness of spirit, as Matthew Arnold used to say, when 
he sees the great University of Harvard launching out into an immense and imposing Business faculty. 
And he laughs sarcastically when he learns that certain American universities of the modern type give 
degrees and diplomas in horticulture, domestic science, salesmanship, drugstore management, etc. The 
Enghshman, nevertheless, is wi'ong. This is the natural way in which a new and developing country 
breaks into education. In such a country the higher education will remain in the air — the privilege of a 
few favorites of fortune — if it is jealously guarded as the region of a few select studies. A new American 
university regards it as its first task to go out into the highways and hedges and compel them to come 
m. In this initial stage its feast must be spiead to tempt the appetite; and it follows the universal habit 
in this business country of discovering what the public wants and giving it without stmt or shame. 
Very unlilce Oxford or Cambridge, no doubt, but it is absurd to compare this bieaking of ground in a 
new country with the traditional life of those ancient institutions. Even they are finding that they have 
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This abandonment of an educational bed of Procrustes, which is still char- 
acteristic of European education, has been brought about not by the more 
flexible concept of culture alone. Three other factors have played an impor- 
tant part in producing this result. First, the traditional justification of “hard” 
subjects, that they train the mind, was proved early in the century to have 
validity only under certain conditions; in other words, formal discipline and 
transfer do not take place automatically, as was assumed for centuries. With 
the rapid development of high schools, which began about 1905, it was 
simpler to abandon the whole doctrine rather than to retain it with the reser- 
vations which were made.^ The second factor, which further differentiated 
American secondary and college education from the European, was the statis- 
tical proof of the existence of wide ranges of individual differences; it was 
found that large numbers of pupils either failed or left school because they 
were discouraged by failure to meet the requirements of a somewhat narrowly 
prescribed curriculum. The third factor was the demand of a public, ac- 
customed to more direct participation in educational affairs and less influ- 
enced by respect for educational and social traditions than is usual in Europe, 
that the schools meet the actual and immediate needs and abilities of theii' 
children. This demand was rationalized into a theory which was critical of 
“deferred values” in education and insisted on the right of pupils to an edu- 
cation which is immediate and efficient. Again, the resultant of these factors 
was to stimulate the study of the individual and the discovery of the right 
education for him. There is an absence of that bureaucratic control which is 
generally characteristic of European countries and which inevitably retards 
the tempo and momentum of change in education, in the United States ad- 
ministrators tend to be more amenable to the demands of the public which 
supports the school with the consequence that education must be “sold” to 
it,^ which means in turn that it must be adapted to its professed demands. 
Further, while the European educator is inclined to deplore the lowering of 
standards due to increased enrollments, the American educator has seized 
upon these increases, which have been far higher than anywhere else in the 

to compromise with new ways, and the new country inevitably starts with them ” This statement ap- 
plies equally, mutatis mutandis, to the high schools On the American background and its eft'ect on 
education see I. L. Kandel, “Philosophy of Education undeilying the System of Ediication in the 
United States” in the Educatiotud Yearbook, 1929, pp. 461 ff. (New York, I. L. Kandel, “The 

American Spiut in Education” in Essays in Comparatioe Edmation, pp. 49 ff. (New York, 1930); 
and L. M. Wilson and I. L. Kandel, Introduction to the Study of American Education, Ch. I (New 
Yoik, 1934). 

^ For a reinterpretation of the doctrine see P. Grata, The Theory of Identical Elements (Columbus, O., 
1928). 

't See I. L. Kandel, Educational Yearbook, 1929, pp. 500 If. (New York, 1930). 
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world, as the opportunity for varying and diU'erenlialiug curricula to meet 
Lire wider range of individual differences^ To put tliis in another way, while 
the European secondary schools and universities are intended for those wlio 
are presumed to be capable of profiting from their courses, the American high 
schools and colleges attempt to provide educational programs from which 
the tested abilities and aptitudes of the students show promise of profiting. 

Up to this point the terms “high school” and “secondary school” have been 
used interchangeably. It must be remembered, however, that the American 
high school is the school for all adolescents, the only post-primary school, in 
which the curriculum traditionally associated with the European secondary 
school constitutes but one of many differentiated curricula offered. With few 
exceptions the American high school is of the cosmopolitan or multiple bias 
type, offering in one building the whole range of courses distributed inEurope 
in secondary schools proper, lradeschools,indusLrial schools, technical schools, 
commercial schools, and household arts or domestic science schools. As a 
result, although admission to the high school is not on a seloclive basis, the 
problem of adaptation to individual differences of aptitudes has placed (lie 
problem of distribution of pupils within rather than at tlie threshold of the 
school as in the European school systems. One method which luis been em- 
ployed has been the introduction of the junior high school, which lias low- 
ered the age of beginning post-primary education to twelve instead of the 
traditional fourteen, and has provided for a series of exploratory courses 
through which pupils could discover their major curricular interests.^ De- 
spite this fact, however, it has been found that pupils or their parents tend in 
the main to elect the academic courses, either because these are still regarded 
as more respectable or because they lead more directly into college. Whatever 
the reason, it is now generally recognized that, despite the exploratory 
courses provided in the junior high schools, too many pupils choose courses 
for which they are not fitted and that the problem of suitable methods of 
distribution is more pressing than ever. The situation has, in other words, 
brought to the fore the problem of discovering more suitable and accurate 
methods of guidance than are provided by the traditional practice of exam- 
inations.^ If the function of education is to discover the abilities and apti- 

1 The crisis in secondar 7 and higher education which is prevalent to-day in all countries is undoubtedly 
due to an increase in the number of students, more highly differentiated in abilities than ever before 
in the history of these educational levels. 

^ See T. H. Briggs, Junior High School (Boston, 1920); L. V. Koos, The Junior High School (New York, 
1925); W. M. Proctor and U. Ricciardi, The Junior High School, Its Organization and Administra- 
tion (Stanford University, Cal., 1930). 

^ See E. L. Thorndike, “The Distribution of Education,” School Review, May, 1932, pp. .335 if.; H. D. 
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ludes of pupils and to arrange for them those courses from which they are 
most capable of profiting the central problem accordingly comes to be, as it 
has in many school systems, that of guidance and the development of methods, 
records, tests which will make such guidance valuable. Nor is this problem 
confined to the high school, for with the rapid increase in the number of 
students in the college it has also had to be faced there. It cannot he denied, 
however, that the problem of guidance is complicated even in the United 
States by the survival of traditional educational values and the association 
between education and social status. 

The rigid adherence to the tradition of culture, which is characteristic of 
European education and which is perpetuated by strong social approval on 
the one hand and official sanctions or privileges on the other, has as its coun- 
terpart the protection of a body of highly specialized teachers. The result 
of this specialization is that on the whole teachers are more interested in their 
own subjects than in their pupils as individuals,^ with two further conse- 
quences, that they tend to be exacting in the maintenance of standards of 
achievement in the subjects which they teach, and that they fail too often 
to see the bearing of these subjects on the general all-round education of the 
pupils under their charge. To some extent these consequences also flow from 
the ever-present pressure of external examinations and of requirements® 
which open the way for the pupils to advancement beyond the secondary 
school, whether to the universities or to selected occupations. The reforms of 
secondary education in Germany in the brief Republican era following the 
War were designed to reduce the pressui-e of specialist teachers and of the 
system of examinations; the experiment was, however, all too brief and the 
teachers themselves too steeped in the tradition to justify any conclusion 
other than those alleged also from the traditional point of view that stand- 
ards were being lowered. A somewhat similar unrest developed in English 
secondary education after the War and concentrated upon criticisms of the 
examination system, one result of which is that noted in the action of the 
Joint Matriculation Board of the Northern Universities (see note p. 7). 
Both in England and Germany (during the Republic) the tendencies of edu- 


Richardson, “The Selective Function of the Secondary School," School Beoim, Nov., 1933, pp. 685 ff.; 
I. L. Kandel, The Dilemma of Democracy (Cambridge, Mass., 1933); J. L. Tildsley, The Mounting 
TVosiie of the American Secondary School (Cambridge, Muss., 1936) 

1 This statement may appear too sweeping if applied to the English schools, and yet, despite the Eng- 
lish emphasis on the foi mation of character as the ultimate aim of education, it is still true that English 
teachers tend to look upon their pupils differently in the classroom and outside of it. 

2 Sanctions in France and Bereohtigungen m Germany. 
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cational thought have moved in the direction of belter adaptation of curricula 
to individual aptitudead 

By contrast the teachers in American high schools are not so highly special- 
ized as in the European secondary schools. With a few notable exceptions the 
requirements for certificates to teach in high schools demand graduation 
from a college without special reference to subject matter specialization but 
requiring a certain amount of preparation in professional subjects. This is 
particularly true in the large number of small high schools where teachers 
may be called upon to teach a variety of unintegrated subjects. There is 
some truth in the criticism which is frequently made that more reliance is 
placed in the preparation of teachers on methods and techniques than on 
mastery of content.* 

The difference between European and American practice may, however, 
be rationalized in the statement that, while the European teacher is a master 
of the subjects which he teaches, the American 1 eacher understands his pupils 
better. One result is that Amerdcan teachers are more ready to accept innova- 
tions; another result which is not wholly due to this cause alone bul lo a 
number of the other characteristics of American education and culture is that 
there is no deep appreciation of or persistence in subjects of study for tlndv 
own sake.* The contrast between the European and American teaclicrs also 
exists in the United States itself, but is not quite so marked, in the contrast 
between the high school teachers and the teachers in colleges who are more 
highly specialized in theii’ subjects. But even at the college level, and largely 
because of the increasing enrollments, there has been a tendency not only to 
relax the requirements for admission but also to permit greater freedom of 
choice in the courses taken by students. There is, in other words, the same 
tendency Lo consider the aptitudes, capacities, and needs of the individual stu- 
dent rather than to fit him into a preordained educational pattern or mould. 

1 The adoption of “aUernative courses” in the secondary schools of the West Riding of Yorkshire and 
elsewhere may be cited as an e.xample. The Consultative Committee of the English Boaid of Education 
IS at present conducting an inquiry into the secondary school curiiculum. 

2 This criticism that Amei ican practice tends to emphasize training in methods at the expense of mas- 
tery of content was the burden of the Report of the League of Natrons’ Mission of Educational Experts 
on The Reorganization of Education in China (Pans, 1930). The Expci ts tended to overemphasize this 
defect because of then lack of familiauty with changes which aie proceeding and with the criticisms 
of the situation cm rent in the United States itself. 

* It is unnecessary at this point to refer to the American “credits,” “units” or “points” system accom- 
panied by the system of electives as contrasted witli the continuity of a coiiise, once selected, in the 
European schools. For a history of the fall and imminent decline of the unit system m Ameiican educa- 
tion the reader is referred to R L. Duffus, Democracy Enters College (New York, 1036), which also 
deals with ciirient expel iinents in a number of colleges to adapt the curiiculum r -quirements lo the 
needs and abilities of the students as individuals. 
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Common Problems in Education 

It would, however, be a serious mistake to exaggerate the differences be- 
tween the educational problems of the United States and the countries of 
Europe and to minimize the existence of a large number of common prob- 
lems. A study of the differences does, indeed, bring into relief the problems 
which to-day equally confront most countries in education. If a science of 
education, using the term in its broadest sense, is to be developed, much is 
to be gained from the study of these common problems as they emerge in the 
varied settings of different national cultures. It is clear that the world is 
to-day confronted with a new orientation in the education of youth. The 
nineteenth century was marked by efforts to establish universal compulsory 
elementary education. The twentieth century has already begun to recog- 
nize the inadequacy of elementary education as a preparation for life in the 
complex world in which we live. These complexities affect every aspect of 
national and international organization — the economic as much as the polit- 
ical, the social no less than the individual. 

On the political side it is realized more than ever before that the mere ex- 
tension of the suffrage based on a training in literacy alone is no longer ade- 
quate; that citizenship in the modern world demands not only a longer and 
more intensive but a more specific preparation than has been provided hith- 
erto.^ From the economic point of view the rapid technological developments 
inevitably mean the unemployability of youth, at least in occupations that 
conduce to the happiness of the individual and the welfare of society, and 
the competition that is developing must affect, as it has already affected, 
both the liberal and other professions. The reduction of the birthrate, except 
m those countries which deliberately foster its increase for military purposes, 
means increased provision for the better care and development of youth. 
From whatever angle the problem is approached, quite clearly a new era is be- 
ginning in which society will prolong its educational tutelage of youth. Just 
as the establishment of universal elementary education was the central prob- 
lem in the nineteenth, so in the twentieth century there is scarcely a country 
in the world which is not concerned with the problems both of the education 
of the adolescent and of higher and professional education. 

As long as the social distinctions between elementary education for the 
masses and secondary education for the select few prevailed the problems in- 
volved were not serious. It was taken for granted that the function of the 
1 This need explains the lapid spread of the “social studies" in elementary and high schools and of the 
gi eater interest in the social sciences in the colleges and universities of the United States. It is paralleled 
in England by the i ecent establishment of the Association for Education in Citizenship. 
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elementary school was to impart literacy and the so-callcd fuudamontals of 
an education and that the purpose of secondary education was to transmit 
the accepted tradition of a liberal education considered at once as the essen- 
tial education for leaders and as a preparation for higher education. But even 
in the field of secondary education the cultural changes of the nineteenth 
century with the increased recognition of the value and place of sciences and 
modern languages and the gradual increase in the number of pupils produced 
an unrest which led to profound modifications in both secondary and higher 
education. 

With the rapid increase in the number of pupils in the secondary schools 
since the War a new unrest has developed. But the situation, as compared 
with that in the last two decades of the nineteenth century, has been com- 
pletely changed. The question to-day is no longer one of revising the curric- 
ula and courses of the secondary schools proper, although that is still in- 
sistent, but of bringing within the purview of a single system the education 
of all adolescents. The reorganization in Italy to which reference has already 
been made, the reform of the educational system in Sweden, and the move- 
ments for the ^cole unique in France, for the Einheitssckule in Germimy,^ 
and for secondary education for all in England; all these movemenls are di- 
rected to the abolition of the traditional dual organization of education, the 
adoption of a common foundation of primary education up to the threshold 
of adolescence, and the creation of alternative types of schools, all of which to- 
gether with the traditional secondary schools, would constitute education at 
the secondary level. 

It is not necessary here to discuss at length the reasons for these move- 
ments, but some of them at least have a bearing on the problems to be con- 
sidered in this volume. The extension of education is, of course, the result of 
the recognition of the inadequacy of elementary education as a preparation 
for life in society to-day; it is equally the result of the inability of adolescents 
to find suitable employment. Beyond this, however, the extension of educa- 
tional opportunities is due to a realization that ability and intelligence are 
not the monopoly of any special stratum in society, and that in the interests 
of national welfare alone it is desirable to utilize all the intellectual resources 
that are available entirely irrespective of class. From the social point of view 
it is also recognized that the results of educational maladjustments, the at- 
tempt to fit square pegs into round holes, may lead to social maladjustment 

^ The Get man movement was abortive except for the establishment of a common Orwndschule for the 
first four years of elementary education. The education of the adolescent is at present the subject of 
inquiry in South Africa and Australia, and in many of the Latin American countries. See in general 
“The Expansion of Secondary Education” in the BdncaUonal Yearhook, 1S30 (New York, 1931). 
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and in turn prove a menace to social stability. By a curious anomaly a move- 
ment which sprang from the recognition of individual worth has also been 
adopted in those countries in which the political theory definitely and ex- 
plicitly denies the worth of the individual.'- In Prance fees have been abol- 
ished in the public lyc^es and colleges so that the authorities may be in a posi- 
tion to get rid of the non-mleurs or inferior students; in Germany the enroll- 
ments in the secondary schools have been reduced indirectly by the limita- 
tion of access to the universities, leaving for solution the serious problem of 
what to do with the excess; in England the introduction of alternative courses 
in the secondary schools of the West Riding of Yorkshire resulted from a study 
of the number of failures in the examinations based on the traditional sec- 
ondary school curriculum. 

What is obvious already in these movements is the recognition that if sec- 
ondary education is to be provided for all, then it cannot be the same for all. 
And even in the traditional secondary school the relatively large number of 
failures raises three questions; How much real education have the failures 
received? How may courses be so diversified as to meet the needs of different 
types of abilities and aptitudes? and. How valid and reliable is the procedure 
of examinations? For the day seems to be passing when a high percentage of 
failures can be interpreted to mean the maintenance of high standards of 
achievement. Nothing is more certain than that much would be lost in lower- 
ing such standards ; but it is equally certain that more can be done than has 
been done in the past (through improvement of instruction or through modi- 
fied differentiation of curricula within the traditional concept of liberal edu- 
cation) to discover the type of education from which every pupil is capable 
of deriving some benefit,^ and to set up a greater variety of standards suited 
to diversities of pupil abilities and aptitude. 

If this presents an accurate picture of the situation in the secondary 
schools proper,^ the problem must inevitably become more complicated when 

1 And so Hitler can -write: “The idea is intolerable that a hundred thousand completely incompetent 
men are considered worthy of higher education, while another bundled thousand of greater ability 
are left without any higher education. It is impossible to e'caggerate the loss incurred thereby by the 
Nation.’’ 

“The national state must regard it as its most important task to open the doors of the public higher 
institutions to all talent, quite equally, no matter flora what social group it comes. It must fulfill this 
task, for only m thrs -way can the proper leadership of the nation arise outside of that group -ivhich 
repiesents a dead learning.” Mein Kampf, 2Sth Edn., pp. 479 and 480. 

^ The psychological effects of success or failure upon the individual need not be discussed here. 

^ See A.M.A., journal of the Assistant Masteis’ Association, January, 1927; County Council of the 
West Riding of Yorkshiie, 22nd Annual Report of the Education Committee, 1923-26, pp. 56 ff.; The 
School Certificate Examination, being the Report of the Panel of Investigators appointed by the Second- 
ary Schools Examinations Council to Enquire into the Eight Approved School Certificate Examina- 
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some form of secondary education is open to all who have coniplelod their 
primary education. The problem thus resolves itself into one of providing 
“the right education for the right pupil under the right teacher,” to quote a 
definition of the function of educational administration by a distinguished 
English director of education, the late Sir Graham Balfour.^ 

Leaving on one side for the present the question of developing the right 
methods for discovering the right education for the right pupil, it is obvious 
that any attempt to define “right education” at the level not only of second- 
ary but of higher education as well must inevitably encounter the serious op- 
position of certain convictions and prejudices as to the meaning of culture or 
liberal education. The whole history of secondary education has, however, 
been the history of the conflict between traditional or established concepts 
of liberal education and attempts to redefine it in accordance with the de- 
mands of changing interests. The last thi-ee hundred years witnessed, lirsl, 
the rise of demands for the inclusion of sciences, I hen of modern languages, 
and later still of other modern subjects in the curriculum of tlu' secoudaiy 
school. The process of adjustment was slow even though secondary educa- 
tion was still designed for a selected group.^ It cannot be claimed lluit aiiy 
definition of liberal education can be accepted as final, paiTieularly al a time 
when it is proposed to provide some form of education for all at the second- 
ary level. The problem has been beautifully defined by M. Leon Brunschvieg; 

It is important that all the children of France should be considered alilfc 
as living plants, whose spontaneous growth will be assured by the same 
methods; only the trunk will be allowed to grow up to a certain height 
before the branches will be permitted to shoot out without the opposition 
of any artificial obstacle to the expansion of their being, whose innate 
powers will raise each up to the level designed for it.® 

The same idea is inherent in a statement in the English Consultative Com- 
mittee’s Report on The Education of the Adolescent: 

A humane or liberal education is not one given through books alone, 
but one which brings children into contact with the larger interests of man- 
kind; and the aim of the schools in categories (II), (III), and (IV) above 
should be to provide such an education by means of a curriculum contain- 
ing large opportunities for practical work and related to living interests. 

tions held in the Summer of 1931 (London, 1932); W. Hartnaoke, and E. Wohlfehrt, Geist und Torheif 
auf Prirmnerbanhen (Dresden, 1934i); and Educational Yearbook, 1930 (New York, 1931). 

1 Sir Graham Balfour, Educational Administration, p. 38 (London, 1921). 

^ See I. L. Kandel, History oj Secondary Education, 2 iassim. (Boston, 1930), 
s Leon Brunschvieg, Tin Ministere de I'Education Rationale, p. 79 (Pans, 1922). 
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In the earlier years the curriculum in these sehools should have much in 
common with that provided in the schools at present commonly known as 
“secondary”; it should include a foreign language, subject to permission 
being given to omit it in special circumstances; and it should be given a 
“practical” bias only in the last two yearsd 

There seems to be a widespread but unwarranted fear that any departure 
from the traditional concept of culture or liberal education will result either 
in lowering standards or destroying them altogether. Rather may it be said 
that any continued attempt to mould all pupils, irrespective of their inter- 
ests and abilities, to the traditional pattern would lead to this result. The 
evidences of educational maladjustment, which the reports of the committees 
of the International Examinations Inquiry have already produced, if they 
have any meaning at all, point to the fact that Non cuivis homim contincjit 
adire Cormthim, the haven of a liberal education, of culture g&ntrale, of 
scholarship as planned at present. It is Loo often forgotten by the staunchest 
and sincerest supporters of the traditional concept that they are the beali 
possidenles whose faith is strengthened by their own success and profit and 
who are prompted by that faith to employ the traditional pattern for the 
selection of an Slite without regard for the large numbers who fall by the way. 

It is obvious that it would be disastrous if standards of scholarship were to 
be sacrificed in order to provide a secondary education for all, but it would 
be equally disastrous if education becomes a mere competitive scramble for 
jobs. Nothing is so certain to-day as that the new age upon which the world 
has already entered demands nothing more than the widest dissemination of 
education; but equally nothing is more obvious from the evidence now avail- 
able than that the task of educators is to redefine the concept of culture and 
liberal education in terms more suited to the world in which we live. Such a 
concept of culture, while holding fast to the best in the tradition, must be 
so flexible that it will meet the highly differentiated interests and abilities 
of the enlarged body of the adolescent group for which new educational op- 
portunities are being planned. There are not many yet, in Europe at any 
rate, who would be ready to accept the statement of the problem as outlined 
by Professor C. Delisle Burns at the first Conference on Examinations: 

I should like to suggest a more general reason for an enquiry into exam- 
inations than M. Bougie has just suggested. It is this; that we in Western 
civilization are going through a transformation as fundamental, certainly. 


^ Board of Edacabon, Repoit of the Consultative Committee on The Education of the Adolescent, pp. 
84i f (London, 1926) The Roman mimei als in the quotation refer to alternative types of schools at the 
secondary level. 
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as tlie industrial revolution, and perhaps oven as lundamental as ilie Ref- 
ormation and the Renaissance. At present the type of person that we ai-e 
producing for certain very important functions is not adequate to their 
fulfilment, and all the tests that we apply arc antiquated. I am afraid that 
I should not agree with M. Bougie, because he seems to imply in his as- 
sumptions that if the successful bank clerk and the successful industrialist 
were more like professors, they would be better persons in those positions. 
I very much doubt that. One of the worst troubles in the whole examina- 
tion system is that it has been devised by professors, and the best thing 
that professors can think of is themselves; they therefore test candidates 
by what are tests of competence for professors, but not for bankers and 
other persons.^ 

If the analysis of the present situation which confronts the educational 
world is accurate, it may be claimed that the reorganization which has taken 
place in secondary and higher education in the United Slates during the last 
thirty years represents an attempt to discover a solution of the type suggested 
by Professor Burns. This does not mean that the American solution has at- 
tained perfection. It is still open to many fundamental criticisms, lliat teach- 
ers are not adequately prepared for the new task; that there is an absence of 
thoroughness in the attainment of objectives; that no adequately recognized 
standards exist; that the system of credits, units or points has militated 
against the development of a sound education and established a largely irrel- 
evant quantitative instead of a relevant qualitative measure of education; 
and that many of the changes have been forced on the schools by the tax- 
paying public or have resulted from loo ready a desire to smooth the path 
for individual pupils and students. The period of reorganization has in any 
case been all too brief and the influx of students into the high schools and col- 
leges has been too rapid to do more than make empirical adjustments to the 

1 Conference on Examinations, p. 236 (New York, 1931). See also the chapter of Professor Burns on 
Examinations and the Social N eeds of the Modern World m Essays on Examinations, pi epared by the 
Engbsh Committee of the International Examinations Inquiry, pp. T9 If. (London, 1935), and the 
replies of laymen to a senes of questions on the haccalauriat in the Fi ench Committee’s report, La Qor- 
reotion des Epreuves Ecrites dans les Examens, pp. 14 If. (Paris, 1936) 

The same idea is conveyed in the following quotation from W. K. Hancock’s Australia, p. 143 (New 
York, 1931) “Democratic sentiment applauds the sound argument that every office boy should have 
a chance to become a manager, and perveits it into a rule that no one shall become a manager who has 
not been an office boy. Australian Governments insist generally upon the rule that everybody must 
enter the public service at the age of sixteen or theveabouls. At the same time, by means of an excellent 
system of scholaiships, they cunningly entice the cleverest boys to the Universities. When they have 
been enticed thither, these boys discover (unless they have entered upon a strictly technical training) 
that there is nothing for them to do except teach. So they return to school and encourage other clever 
boys to win scholarships. In this way the State has most ingeniously contrived that its system of demo- 
cratic education .shall not embariass the public services by introducing into them resplendent talents. 
There has it is true been considerable reform in lecent years.” 
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demands of the situation. Professor Thomas H. Briggs, a recognized author- 
ity in the field of secondary education, has, indeed, made the statement that 
the United States docs not have a philosophy of secondary education.’- While 
the primary concern in the past two decades has centered upon the rapidly 
increasing body of students in secondary and higher education — the question 
of dealing with large numbers satisfactorily — there has been a growing con- 
cern in the last few years about the quality of education. 

The International Examinations Inquiry 

It is at this point that the type of intellectual cooperation undertaken by 
the International Examinations Inquiry derives its meaning and significance. 
The European countries, it may be said, have stressed the maintenance of 
standards of quality in education with a consequent sacrifice of those whose 
abilities and aptitudes do not fit them into the traditional mould; the United 
States has stressed equality of educational opportunities, the result of which 
has been to open the high schools and colleges in practice to every boy or girl 
who seeks admission with a consequent sacrifice of quality. The European 
countries are ready to open the doors of secondary education more widely 
than hitherto; they may have much to learn from American practice, posi- 
tively and negatively. On the other hand, the European countries are firmly 
resolved not to sacrifice the traditional standards of quality; in the present 
stage of unrest the United States may have much to learn from the further 
developments in Europe on this aspect of the problem. On both sides the 
fundamental issue is slowly ceasing to be one of selection and is becoming one 
of distribution, or the discovery of the right education for the right pupil 
under the right teacher. 

Ultimately, then, the problem resolves itself into devising methods by 
which the right education can be discovered for the right pupil. The tradi- 
tional method of selection has been by examinations. European studies of 
examinations up to the present seem to indicate that neither examinations 
as now conducted nor the teachers’ judgments furnish reliable bases for such 
distribution.^ It is on this question that far more experimentation and some 
progress, perhaps not always commensurate with the amount of experimen- 

1 See T. H. Briggs, The Great lavestmeat (Cambi idge, Mass , 1930) and Secondary Bducation (New 
Yoik, 19S3). 

2 Reference need be made heie only to C W Valentine, The Relmhihty of Examinations (London, 
1933); Sir Philip Hailog and E C, Rhodes, An Evamination of Examinations (London, 1935), 0. 
Bobertag, Schulerauslese (Beihn, 1934.); W Hartnacke and E. Wohlfahit, Geist und Toihett auf 
Primanerbanlen (Dresden, 1934), and Commission Fran^aise pour I’Enqufite Carnegie, La Correction, 
des Epreuves Ecrites dans les Examens (Paris, 1936). 
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cism and resistance which the movement inevitably encountered at the start 
has been overcome. If the results of the investigations in the European 
countries are to bear fruit and if these countries are confronted with the 
crucial problem of the distribution and differentiation of education, much in 
American practice may be found suggestive for the next steps to be under- 
taken. The use of achievement and of placement tests, the results of the 
Pennsylvania Study conducted by the Carnegie Foundation, the employ- 
ment of aptitude tests, and the development of cumulative record cards as 
instruments for educational guidance will have their contributions to make 
to European thought. On the other hand, it may be hoped that the projec- 
tion of these techniques against the European background of culture and 
thoroughness may produce results which will be of significant value for 
American educators. 



CHAPTER TI 

THE TRADITIONAL EXAMINATION 
Early History 

W RITTEN examinations appear to have been unknown in the United 
States until about the middle of the nineteenth century. Until that 
time schools and even colleges had annual “examinations” or inspections by 
school “visitors” or trustees. In Massachusetts an Act passed in 1789 made 
it the duty of the minister or ministers of the gospel and the Selectmen or 
others specially chosen by the locality to encourage school attendance 
and once in every six months at least, as much of tener as they shall deter- 
mine it necessary to visit and inspect the several schools in their respective 
towns or districts, and shall inquire into the regulation and discipline there- 
of, and the proficiency of the scholars therein, giving rcasoiinble notice of 
the time of their visitation.^ 

This provision only confirmed a practice which had already been introduced 
in Boston in 1709 when the town px’oceeded to 

nominate and appoint a certain number of Gentlemen of Liberal Educa- 
tion, Together with some of the Rev*^ Ministers of the Town ... to Visit 
ye school from time to time, when and as Oft, as they Shall thinlc fit, to 
Enform themselves of the Methodes Used in Teaching of the Schollars 
and to Inquire of their Proficiency . . . the Master being before Notified 
of their Comemg.^ 

In 1789 Boston appointed a visiting committee to carry out the requirements 
of the Massachusetts Act of that year. In addition to general inspection and 
supervision it was the duty of the committee 

to examine the Scholars in the particular branches which they are taught, 
and by all proper Methods to excite in them a Laudable ambition to excel 
in a virtuous, amiable deportment and in every branch of useful knowl- 
edge.^ 

Such examinations were, of course, oral, and were conducted either by the 
teachers themselves under the supervision of the visitors or by the visitors 
themselves. Mass examinations could in fact not be conducted, since instruc- 
tion was in the main individual, each pupil recited to his teacher, and ad- 
vancement or promotion from one stage to another depended upon the teach- 

1 Quoted in Su^zallo, II , The Jiiie of Local Supei vision in Massachusetts, p. 40 (New York, 1906). 

^ Ihid., pp 87 f. 

^ Ibid., p. 106. 
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er’s opinion of the pupil’s readiness. The earliest entrance requirements to 
Harvard simply provided that 

When any Scholar is able to understand fully, or such like classical Latine 
Author extempore, and make and speake true Latine in Verse and Prose, 
suo ut aiunt Marie; And decline perfectly the Paradigms of Nounes, and 
Verbes in the Greek tongue; let him then and not before be capable of ad- 
mission into the Colledge. 

It was not until 1734 at Harvard College and 1745 at Yale that examination 
by the president and tutors was added specifically to the requirements for 
entrance. 

The external examination by a committee of visitors was the practice up 
to the close of the eighteenth century. Thus the Harvard College laws were 
revised in 1790 and 

Among other improvements, “to excite the students to a noble emulation,” 
a public annual examination was established, to be held in the presence 
of a joint committee of the Corporation and Overseers. This Committee, 
after examining the students of each class in the several branches studied 
by them during the year, were, with the President, Professors, and Tutors, 
to determine by ballot those who had distinguished themselves, and report 
their names to both boards, to be entered on record as a testimonial to their 
literary merit. ^ 

The examination was not popular and after some disturbances and petitions 
by the students the laws were again amended in 1796 and the control of the 
examination was delegated to the professors and tutors alone without the 
assistance of an external committee. 

The general practice, then, both for entrance to college and in the college 
itself appears to have been the admission or promotion of students when they 
were “judged ripe.” Provision was made for oral examinations but how rigor- 
ously this provision was enforced is not clear." 

In the secondary schools, the academies and later the high schools, exam- 
inations were public and were conducted cjuarterlyor annually by committees. 
Thus in 1770 the Trustees of the Philadelphia Academy “considering that 
nothing can contribute more to keep up a laudable Emulation and Diligence 
among the Youth educated in this Seminary, than regular and stated exam- 

^ J. Quincy, The History of Hai vard University II, p 979 (Boston, 1860) See also M. L. Small- 
wood, An Historical Study of Examinations and Grading Systems in Eatly Ameucan UniversHies^ 
Ch. II (Cambridge, Mass , 1935), and S E. Morison, Haruaid College in the Seventeenth Century, pp. 
67 ff , 81, 1'1<7, 206 f , 453, 458 (Cambudge, Mass., 1936). 

2 See E. C. Bioome, A Historical and Critical Discussion of College Admisi^ion Requirements, p, 37 
(New York, 1902). 
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inaiions of the different schoolb and bestowing PreniiumK and other marka of 
approbation on the most deserving Scholars” a^ipoiiiled four days in the year 
for such examinations d There were no fixed praclic('s. Examinations were 
held every quarter or every term (Leicester, 18*21, and Lowell, 1832), or an- 
nually as well as at other fixed dates (Salem, 1836), or semi-annually (Salem, 
1843), or even monthly (Portsmouth, 1847) d In 1845 Boston had two Sub- 
Committees, one of the Latin School and the other of the English High 
School. The first of these reported on August 5, 1845, “that they had exam- 
ined said School on the 24th ultimo, and found it in its usual good condition.” 
The second Sub-Committee after visiting the English High School on four 
dift'erent days in July for the purpose of making the Quarterly and Annual 
Examinations “were impressed with the thoroughness and accuracy mani- 
fested by the scholars generally in their various studies”; the proficiency in 
algebra and geometry was great but in French they noted a deficiency in 
pronunciation, but 

The result of the examination has satisfied the Commit Leo that the School 
maintains the high character which it has long held; and although they 
are far from intimating that there is no further room for improvomout, 
they are fully of the opinion that this Board and the Public have no reusmr 
to be dissatisfied with its present condition.’' 

By the middle of the nineteenth century public examinations wore gen- 
erally held once a year and were more in the nature of public displays or ex- 
hibitions to show off brilliant pupils or to glorify the teachers. It was as a re- 
sult of abuses to which such displays gave rise and of the criticisms which 
they prompted that written examinations began to be introduced and the 
public examination was replaced by graduation exercises and the distribution 
of diplomas to those who had passed a satisfactory examination conducted 
by the teachers.'* 

In the elementary schools the conduct of annual examinations by specially 
appointed committees was also the practice, but with the rapid increase in 
enrollments the difficulties and ineffectiveness of the system were recognized 
earlier at this educational level than in the secondary schools with relatively 

1 J. Mulhern, A Bistory of Secondary Education in Pennsylvania, pp. 209 f. (Philadelphia, 1933). 

^ See E. D. Gi izzell, Origin and Development of the High School m New England before 1S85, pp. 331 f. 
(New York, 1933). 

^ Quoted in O. W. Caldwell, and S. A. Couitis, Then ^ Noio in Education, 1S43’1923, p. 166 (New 
Yoik, 1924J. 

* See Giizzell, op. cit., p. 334, and Mulhern, op cit., p. 140. Public examinations by the school boards 
or by sub-committees continued to be conducted in the ’sixties at the end either of each term or of 
each year; see H. Barnaid, Amei lean Journal of Education, Vol. XIX, pp. 440 f. 
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smaller numbers. TKusin Boston, wKerctwo Sub-Commiltees were appointed 
annually, one to examine the Writing Department and the other the Gram- 
mar Department, the Sub-Committee for the latter reported in IStS that it 
was “impossible to do anything like justice on the examination, for Com- 
mittee-men could not be found who could give the time to examine over 
7,000 children.” Nor was the task less formidable when the examination was 
limited to the first class in each of the nineteen schools of the city. The Sub- 
Committee accordingly decided to introduce a written examination “in addi- 
tion to the usual mode of oral examination.” The printed questions for the 
written test were so graduated that the simpler could be introduced and 
answered by any children of common sense and ordinary attainments, while 
the more difficult would tax the powers of the best of our scholars without 
being quite beyond Lhem.^ 

The purposes which inspired the Committee in introducing what was re- 
garded as an innovation in school practice are as interesting as they are 
modern in their definition of what should constitute a good examination. 
It was our wish to have as fair an examination as possible; to give the 
same advantages to all, to prevent leading questions; to carry away, not 
loose notes, or vague remembrances of the examination, but positive in- 
formation, in black and white; to ascertain with certainty what the schol- 
ars did not know, as well as what they did know; to test their readiness at 
expressing their ideas on paper; to have positive and undeniable evidence 
of their ability or inability to construct sentences grammatically, to punc- 
tuate them, and to spell the words.* 

The Committee was desirous of having not only an adequate examination 
for each school, but a common examination which would yield results to make 
comparisons between all the schools of Boston possible. Accordingly the 
Committee asserted that 

to the best of our Icnowledgc and belief, the statistical returns which we 
submit will present the fullest and fairest means for judging of the real 
merits and demerits of our Schools, and of their comparative rank, which 
have ever been embodied so as to be within the reach of any but actual 
examiners of the Schools. We may say this safely, because it is perhaps the 
only statistical information which has ever been so embodied.® 

Horace Mann commented enthusiastically on the written examination in 

1 See Caldwell and Comtis, op. cit., p. 168. The full report of the Committee, as well as Hoi ace Mann's 
comments on this innovation m The Common School Journal, Vol. VII, are reprinted m this book. 

2 Caldwell and Courtis, loo. oil. 

3 Caldwell and Courtis, op. oil., p. 170 
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The Common School Journal, Vol. VH. His cullmsiasm was shared iieiLht'r 
by the public nor by the teachers of Boston, particularly as the Committee 
had reported that “the first feeling occasioned by looking over these relnrus 
is that of entire incredulity” that so many pupils were unable to answer the 
questions set in the examination. Horace Maun was more farsighted than 
his teachers and analyzed the merits of the written examination with great 
penetration. (I) This method of examination is impartial, since the same 
questions are set to all pupils in the same class in all schools.^ “Scholars in 
the same school, therefore, can be equitably compared with each other; and 
all the different schools are subjected to measurement by the same standard.” 
Further , the questions in a written as contrasted with those in an oral examina- 
tion are equal in ease or difficulty. (2) The new method is far more just than 
any other to the pupils themselves. In an oral examination of a whole class 
each pupil is questioned for at most two minutes; while in the written Lest 
he has a whole hour in which to arrange his ideas. (3) Accortlingly the method 
under consideration is the most thorough, since pupils are not subjcclcd to 
the chance of the few questions that can be given in the brief Lime of an oral 
examination but have a wider range suited to a grealcr range of atlainment 
and ability. (4) The written examination does not, like the oral examination, 
give the teacher an opportunity to interrupt the procedure or offer suggestions 
to the pupils. (5) It removes all possibility of favoritism. (6) II determines, 
beyond appeal or gainsaying, whether pupils have been faithfully and com- 
petently taught, for while the oral question lends to call forth a factual an- 
swer, in the written examination the pupils are able to develop ideas and 
show the connections of facts. (7) Finally, in a written examination “a tran- 
script, a sort of Daguerreotype lileeness, as it were, of the state and condition 
of the pupils’ minds, is taken and carried away, for general inspection”; that 
is, a permanent record is available by which schools may be compared with 
each other or each school may measure its own progress. A recognized stand- 
ard of comparison is thus available, as contrasted with the different stand- 
ards of judging in the minds of different men, for “if every man’s foot is to be 
taken as twelve inches long, it becomes an important question by whose foot 
we shall measure.”® Horace Mann thus not only defined the fundamental 
problems in any system of examinations, but anticipated by implication the 
need of some form of recognized standai’dization. 


1 It IS curious that the Sub-Coiuttiittee had not hit upon the idea of setting the same examination at the 
same time, but went from school to school as lapidly as possible m oider lo pi event any leakage of 
the questions. 

^ Caldwell and Courtis, op. cit., pp. 2S8 ff. 
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The superintendent of the Chicago schools reported in 1857 the introduc- 
tion of a written examination for admission to the public high school. “Every 
effort is made to put the candidates as much at their ease as possible, and 
secure them from all unnecessary embarrassments.” To prevent favoritism 
or bias the candidates were given numbers, their names being recorded on 
identification slips. “Besides the teachers of the school, on whom the exam- 
ination chiefly devolves, several members of the Board of Inspectors and the 
superintendent are in constant attendance, aiding and directing in the differ- 
ent exercises.” Great care was taken to secure reliability and uniformity in 
the standard of judgment; the papers whose averages came within five or 
ten per cent of the lowest rank admitted were rechecked by the principal of 
the school and the superintendent. The written examination, it was claimed, 
gave all candidates a better opportunity of doing themselves justice than did 
an oral examination. Of all experiments with examinations “the written ex- 
aminations afford the most reliable test of qualifications, and are on the whole 
the most just and satisfactory to all parties. This mode of examining is now 
adopted in nearly all the principal cities of the Union.” 

The method of the written examination was adopted in 1856 not only for 
admission to the public high school but for purposes of promotion. In the 
opinion of the superintendent 

These written reviews are among the most successful means for secur- 
ing thoroughness and accuracy of scholarship. . . . This mode of examin- 
ing a class accomplishes at least three important objects at the same time. 
It affords a thorough test of the pupil’s knowledge of the subject; it is one 
of the best methods of cultivating freedom and accuracy in the use of 
language; and it furnishes a valuable discipline to the pupil’s mind, by 
throwing him entirely on his own resources.^ 

Early Criticisms of Exa.minations 

Opposition to examinations began in the eighties. They were criticized 
because of the stress on uniformity, “a system of strait jackets” as they were 
called by one superintendent, and because they encouraged pupils to study 
for marks. In the words of Superintendent Streeter of Titusville, Pa., 

There is nothing definite about them. No two teachers would mark the 
same paper alike; and I have sometimes wondered how much a night’s rest 


^ H. American Journal of Education^YoX III, pp. 539 fF, gives a portion of the Third Annnal 

Report, 1856, of W. H. Wells, Supenntendent of Schools in Chicago 
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or a breakfast has to do with papers marked 08 and 90 on I he one hand, 
and 15 and 0 on the other 

There began to develop at this time a lack of confidence in the value of mai’k- 
ing and in the justice of examination systems. And yet there was recognized 
the need of some method of standardizing the work of the seliools and of 
some measures by which the work of schools over a large area couUl bo com- 
pared. Thus Superintendent B. P. Patterson of Pottsville, I’a., in his report 
to the State Superintendent in 1888 writes 

We have always thought that there should be some means by which we 
would be enabled to compare our work one with another. . . . What we 
would like to have is some test by which wc can measure work. . . . Let us 
stop talking and compare our work. . . . But we would like to have com- 
parative statistics on other subjects, for instance; How long should it Lake 
the average pupil, in reading, to reach the fourth reader? Again, whal per 
cent of our monthly enrolment are in fourth readers or beyond il ? At what 
average age should pupils be expected to readily solve miscellaneous prob- 
lems in the fundamental rules; such problems as they will itieeL in any 
ordinary calling. Each borough superintendent has I he means of knowing 
the comparative standing of each school of the same grach* in his own dis- 
trict; but we are all unable to compare our own sclrools with those of any 
other district in the State.^ 

The enthusiasm with which Horace Mann welcomed the introduction of 
the written examinations began to wane before the close of the century. At 
the high school level the domination of college entrance examinations began 
to be attacked. In the practice of tbe elementary schools examinations for 
promotion were subjected to criticism. In both cases the burden of the criti- 
cisms were based on the recognition that “uniformity of conditions in pupils 
does not exist”; pupils are unequal in mental ability, vigor, ambition, appli- 
cation, home advantages, and health. They begin the school year with un- 
equal attamments and finish with greater differences because of a lockstep 
system, crowned by examinations applied equally to the able, the average, 
and the poor pupils. 

The use of stated examinations, wrote Superintendent E. E. White of Cin- 

^ Quoted fiom the Pennsylvania School Journal, Vol. 35, 1886, p. 128, in J. Mulhem, A History of 
Secondary Education in Pennsylvania, p. 593. The same idea was given poetical forni by A. T, Godley 
in hi3 “Rubaiyatt of Moderations” (in Lyra Frivola, Methuen, London, 1899): 

'Twixt Right and Wrong the Difference is dim: 

’Tis settled by the Model ator’s Whim: 

Perchance the Delta on your Paper marked 
Means that his Lnnch has disagreed with him. 

Quoted m Mulhern, op. cit., p. 594, from the Report of the State Superintendent, 1888, pp. 163 f. 
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cinnati, as the sole means of determining the fitness of pupils for promotion 
has been attended with serious perversions of true school work It has nar- 
rowed and grooved instruction, encouraged the use of mechanical and rote 
methods, and occasioned cramming and vicious habits of study d As a conse- 
quence faith in the value of the written examination as a method of deter- 
mining fitness for promotion had been shaken. 

A few years ago the use of the written examination as a basis of promo- 
tion was well-nigh universal in graded schools. But the serious evils attend- 
ing the examination system have demanded wide attention, and, as a 
result, many cities have either modified the system or abandoned it alto- 
gether. The evidence of these changes is as conclusive as it is gratifying.® 

The result of the unrest was indicated in the answers to a questionnaire 
which showed that, while the written examination was still used to determine 
fitness for promotion from class to class and from school to school, there was 
a strong tendency to rely on the judgment or estimates of the teachers, some- 
times alone, sometimes supplemented by an examination. All the arguments 
pointed to the elimination of stated examinations, which were practically ex- 
ternal in character. It was found that there was great variation in the mark- 
ing, ranging from one to twenty per cent in different schools. But what was 
regarded at that lime as a more serious indictment of the system of examina- 
tions was their effect upon instruction and methods of study. “The guiding 
question becomes not what is best for the pupil, but what will ‘count’ in the 
examination.” It was recognized that “the best study is done where there is 
the freest play of natural motives, and the poorest study where there is the 
most absorbing interest in examination marks,” leading to overpressure, 
strain, waste, dishonesty, and miseducation. 

For the stated examination were substituted frequent examinations by the 
teachers for instruction purposes, and cumulative records of the pupils’ stand- 
ing. The leading cities were beginning to promote on the judgments of the 
teachers and on the class standing of the pupils without stated examinations. 

We thus reach the decisive question involved in the promotion of pupils 
on their success in daily work. This success must be reliably determined, 
and the only means of doing this, in the absence of examinations held for 
the purpose, is the teacher’s judgment, recorded or otherwise, and sup- 
ported, as it may usually be, by the judgment of the principal.''’ 

' E. E. White, Promotions and Examinations in Graded Schools. U. S. Bureau of Education, Circulai 
of information, No. 7, 1891, p. 14< 

2 Ibid., p. 28. 

3 Ibid., p. 43. 



30 THE TRADITIONAL EXAMINA^l’ION 

Teachers, it was argued, are us competent to deleriiiiiie tlic' <'oiiiparaliv(‘ siie- 
cess of their pupils as they are to mark examination piipers. lii Canoimiali 
examinations for promotion had been abolished in I8BG and ro[)lac'e(l by I he 
teachers’ estimates. In the first year of the transition both ('xaminalions and 
estimates were used, but at the close of this year there was a general eoneur- 
rence in the belief that teachers’ estimates in the last five months representeil 
the fitness of pupils for promotion more reliably than the results of (examina- 
tions in the first five months of the year. Fewer pupils were promoted on the 
estimate plan than on examinations; and although pupils who were not pro- 
moted could claim the right of a written examination, the number of such 
applications decreased each year. The number of applicants who succeeded 
in reaching the standards for promotion on the basis of an examination was 
almost negligible, thus corroborating the reliability of the ti'aelu'r.i’ judg- 
ments. The teachers recorded careful estimates of llic pupils’ (idelily and suc- 
cess in the different branches of instruction without daily marking or exam- 
inations. The inquiry concluded, however, that the coulimianee of examina- 
tions by the teachers was desirable for instruction pnrpo.S('s. The ieaelier 
“must loiow to what extent his instruction has been ap|)i()prial('(l by each 
pupil in his class,” and “testing is as essential a part of Leaeliing as insi ruc- 
tion itself,” and may lead to earnest re-teaching of a subjc'cl . 

At this time President Charles W. Eliot of Harvard Colh'ge began his at- 
tack on examinations and his plea for an adequate consideration of individual 
differences. In his inaugural addi-ess, delivered in 1809, he had not only in- 
sisted upon strict standards of admission to prevent “a waste of instruction 
upon incompetent persons,” and annual examinations, but had deplored the 
absence in American colleges of external examinations of the type found in 
Europe. 

When the teacher examines his class, there is no effective examination 
of the teacher. . . . The American practice of allowing the teaching body to 
examine for degrees has been partly dictated by the scarcity of men out- 
side the faculties who are at once thoroughly acquainted with the subjects 
of examination, and sufficiently versed in teaching to know what may fairly 
be expected of both students and instructors. This difficulty could now be 
overcome. 1 

In a discussion of The Gap between Common Schools and Colleges (1890) Presi- 
dent Eliot urged the careful preparation and marking of examinations, but 
on the whole seemed inclined to favor the further extension of systems of in- 
spection. 

1 C. W. Eliot, Educational Reform, pp. 9 f. (New York, 1901). 
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We may expect state examining and inspecting systems to improve and 
extend, for they have demonsti’ated their utility; and, remembering the ex- 
tremes to which examination methods have been carried in England, we 
may reasonably hope that state boards will more and more inspect insti- 
tutions as well as examine individuals. The profession of school inspector 
will, therefore, become recognized as a separate and honorable calling.^ 

Two years later President Eliot fell in with the prevailing criticisms of ex- 
aminations but approached the problem from an entirely different angle, an- 
ticipating later thought on the subject by nearly a quarter of a century. His 
attack on mass examinations was stimulated by his fear of uniformity, of the 
lockstep in education, of the attempt to treat all pupils and students alike. 
Other things being considered he wished the theory upon which he had intro- 
duced electives at Harvard College to be applied at all levels of education. 
This meant, of course, a more rational interpretation of the application of 
the democratic theory to education than was popular either in his day or 
even in our own time. Thus in his address delivered before the National Edu- 
cation Association on Shortemny and Enriching the Grammar School Course 
he defined the problem as follows; 

The democratic theory, it is said, implies equality among the children, 
uniformity of programme, uniform tests for promotion, and no divisions in 
the same schoolroom according to capacity or merit. I need not say to this 
audience that these conceptions of true democracy in schools are fallacious 
and ruinous. Democratic society does not undertake to fly in the face of 
nature by asserting that all children are equal in capacity or that all 
children are alike and should be treated alike. Everybody knows that chil- 
dren are infinitely diverse — that children in the same family, even, are 
apt to be very different in disposition, temperament, and mental power. 
Every child is a unique personality. It follows, of course, that uniform pro- 
grammes and uniform methods of instruction, applied simultaneously to 
large numbers of children, must be unwise and injurious — an evil always to 
be struggled against and reformed, so far as the material resources of demo- 
cratic society will permit. It is for the interest of society as well as of the 
individual, that every individual child’s peculiar gifts and powers should be 
developed and trained to the highest degree. Hence, in the public schools of 
a democracy the aim should be to give the utmost possible amount of indi- 
vidual instruction, to grade according to capacity just as far as the number 
of teachers and their s tr eng th and sldll will permit, and to pr omot e pupils , not 
by battalions, but in the most irregular and individual way possible. . .Uni- 
formity is the curse of American schools. That any school or college has a 


^ Ibid; p. 218. 
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uniform product should be regarded as a deiuouslratiou of inferiorily — 
of incapacity to meet the legitimate demands of a social ordei’ whose funda- 
mental principle is that every career should be open to talent. Selection of 
studies for the individual, instruction addressed to the individual, irregu- 
lar promotion, grading by natural capacity and rapidity of atLainuicut, and 
diversity of product as regards age and acquisitions, must come to charac- 
terize the American public school, if it is to answer the purposes of a demo- 
cratic society.^ 

The same thesis was repeated in the same year (1892) in another address 
on Undesirable and Desirable Unijormity in Schools, an address in which the 
place of examinations in the interpretation of democratic education was de- 
fined. 

Flexible and diversified school programmes will give all the children their 
most favorable chance; stiff and uniform programmes will nol. . . . I’bere 
must be examinations, anticipated and unanticipated. Lei Ihem always 
be conducted by the teacher, for the teacher, and as helps and guides in 
teaching and learning. The teacher needs to ascertain, from lime lo lime, 
by such tests how his instruction has been assimilaled by his class; and 1 he 
pupils need to learn from them what the teacher expects of his elass.“ 

President Eliot continued the same plea for adaptation lo individual capac- 
ities in 1897 in a discussion of The Function oj Edvcalion in Democratic 
Society in terms which constitute one of the main theses of the Pcmisylvania 
Study conducted by the Carnegie Foundation (see pp. 133 f.). 

Another important function of the public school in a democracy is the 
discovery and development of the gift or capacity of each individual child. 
This discovery should be made at the earliest practicable age, and, once 
made, should always influence, and sometimes determine, the education 
of the individual. It is for the interest of society to make the most of every 
useful gift or faculty which any member may fortunately possess; and it is 
one of the main advantages of fluent and mobile democratic society that it is 
more likely than any other society to secure the fruition of individual capac- 
ities. To make the most of any individual’s peculiar power, it is important 
to discover it early, and then train it continuously and assiduously. It is 
wonderful what apparently small personal gifts may become the means of 
conspicuous service or achievement, if only they get discovered, trained, 
and applied. . . . The vague desire for equality in a democracy has worked 
great mischief in democratic schools. There is no such thing as equality of 
gifts, or powers, or faculties, among either children or adults. On the con- 

1 Ibid., pp. 362 and 265. 

^ Ihd; pp. 381 and 285. 
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trary, there is the utmost diversity; and education and all the experience 
of life increase these diversities, because school, and the earning of a liveli- 
hood, and the reaction of the individual upon his surroundings, all tend 
strongly to magnify innate diversities^ 

The theory of diversification and differentiation of education "was sound; 
there were, however, no instruments or techniejues available whereby indi- 
vidual differences of capacities and interests could be discovered or measured. 
Nor was the United States any more ready than the European countries at 
that time to redefi^ne the concept of education and culture, although the un- 
rest was just beginning in the last decade of the nineteenth century. President 
Eliot was sound in decrying uniformity of aims and standards, but he did not 
recognize or suggest any substitutes for examinations other than the teach- 
ers’ judgments nor did he realize the difficulties involved in the conduct and 
marking of examinations. 

The earliest attack on the second of these problems was made m a paper 
on 2'ke Right Reform of Examinations, read at the Phst Annual Convention 
of the College Association of the Middle States and Maryland (1890) by 
J. Rendell Harris, Professor at Haverford College. Professor Harris, while he 
acknowledged the values claimed for examinations, such as recapitulation 
and concentration of studies, suggested that “the first thing to be reformed 
is the examiner.” Examinations would not be improved until the examiner 
had a clear notion of what to aim at. The attempt to make all of a group of 
students satisfy a certain task equally is a reductio ad absurdum; “methods 
which aim at democratic results have no place in examinations.” Nor is the 
purpose of examinations one of passing some students and failing others hut 
of discovering how the students stand in relation to each other. “A well con- 
ducted examination divides the students one from another like the opening 
out of a fan. I affirm that the first thing to be aimed at is to produce a dis- 
persion among the group of persons presented for examination,” and the more 
dispersion a teacher produces, the better examiner he is. 

Our purpose is to show how unequal students are to one another; and 
the right way to do this is not by setting up a standard of passing or failing, 
as if there were only two conceivable students A and not A (the elect and 
the non-elect) , nor by the a priori assumption that there are four conceiv- 
able classes of students, say A, B, C, D, of which D stands for the non- 
elect; but by recognizing that there are in reality as many classes as there 
are students, and trying to make this fact as patent as possible by the 


^ Ibid., pp. “lOS f. 



34 THE TRADITIONAL EXAMINATION 

process of examination, we can come Lo the tpiestion ol lickolini^ or biaok- 
eting afterward.^ 

This means that examiners and teachers when they profess lo give certain 
grades, say on a scale of 100, are proceeding on an artificial theory for which 
there is no foundation, as is shown in the variation of marks for the same 
paper by different markers. 

I repeat, however, that the whole process of classification of students is an 
induction, based upon the observation of dispersion. And it follows, there- 
fore, that the democratic method, which aims at producing the greatest 
possible number of equal and similar molecules, each ticketed with the 
same alphabetical symbols, is unscientific, since it reduces dispersion al- 
most to the lowest possible point.^ 

An individual’s place on a normal curve of distribution, which is what Ero- 
fessor Harris means by “dispersion,” is more important than an alphabetical 
or numerical mark. Professor Harris deplores the absence of standards (tlu'rc 
are “as many currencies as there are institutions”) result iiig from the pi-ac- 
tice by which teachers are responsible for training, examining, ami marking 
their own students without any external check. Like President Eliot he recom- 
mended the creation of some body of external examinations which would 
contribute to the improvement of secondary education “with the full inlmi- 
tion that we will gather only the good fish into their appropriate vessels and 
throw the bad away.” ® 

Rise op the Accrediting System 

Professor Harris was some fifteen years ahead of his time in his method 
of approach to examinations. The more technical study of the problem had 
to await the introduction, first, of statistical methods in educational research, 
and, secondly, of standardized norms in the form of scales and tests. The 
practice of conducting external examinations of pupils in elementary schools 
had, with few exceptions, disappeared before the close of the nineteenth cen- 

1 Proceedings of the First Annual Convention of the College Association of the Middle States and 
Maryland, 1890, p. 90. 

® Ibid., p. 94, 

s Professor Hama, a philologist, paleogi apher, and biblical scholar, had come from Cambiidge Uni- 
vei sity in 1893 to accept a piofessorslnp at Johns Hopkins University; in 1886 he joined the faculty of 
Haverford College. He admitted that his own standards had suffci'ed because of the absence of external 
checks and his personal lesponsibihty to his students, “In dealing with the students, my aim is to let 
them all thiough, or nearly all, on as good a grade as possible, because I am one of those peisons who 
would not willingly set foot on a worm, especially worms that would turn — and rend you.” (^llnd., p. 96.) 
It is to be noted that Piofessoi F. Y. Edgeworth’s attack on examinations appeared at this time. In 
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tuiy. The problem was most pressing at the point of relationship between 
high schools and colleges. This, indeed, was the chief preoccupation in the 
last decade of the nineteenth century. It was generally charged that the 
high schools could not carry out their aims and purposes as long as they were 
dominated by inelastic and inflexible requirements for admission to college 
and so long as these requirements differed for different colleges. 

The problem had been settled to some extent in the Middle West and West 
by the adoption of the accrediting system which had been first adopted by 
the University of Michigan in 1870. The system, while it abolished entrance 
examinations and introduced the practice of inspecting high schools, did not 
at that time develop any greater degree of flexibility in the entrance require- 
ments. It simply meant that students who had completed these requirements 
and were recommended for admission to the University by the principal of a 
school accredited after inspection could be admitted without examination. 
Changes and modifications in the entrance requirements were to follow much 
later as the enrollments in the high schools expanded and the number of stu- 
dents proceeding to higher education increased. More recently it has come 
to be realized that even a system of inspection and external standards for 
accrediting of schools fails to provide an adequate method of standardizing 
the quality of instruction and attainments. The somewhat vague and varied 
requirements for certificating high school teachers and the equally vague 
standards of marking among a large body of teachers has led to the adoption 
of academic tests, sometimes statewide, occasionally regional, in scope to 
supplement other methods of accrediting.' 

Admission to College bt Certification 

The unrest caused by the so-called dominance of college entrance require- 
ments and by the desire to allow greater flexibility to the high schools was 
to some extent met by the adoption of the accrediting system in the Middle 
West and West. In the New England States the same difficulty was met by 
the establishment in 1902 of The New England College Entrance Certificate 

an article on “The Statistics of fi’iammations” (Jouimd of the Royal Statistical Society, Vol, Sl, 1888, 
pp. 599 flf.) Edgeworth wrote “That the examination is a very rough yet not wholly inefficient test of 
merit is geneially admitted. But I do not know that anyone has attempted to appreciate with any ap- 
proach to precision the degree of accuracy or inaccuracy which is to be asciibed to the modern method 
of estimating proficiency by means of mimeiical marks. It occurs to me that the method of effecting 
this computation is contained in that part of the Calculus of Probabilities which is known as the Theoi y 
of Errors The doctrine of chance and error is eminently germane to the present subject.” This article 
was followed two yeais later by another on “The Element of Chance in Competitive Examinations” 
{Joui nal of the Royal Statistical Society, Vol. 53, 1890, pp. 460 ff. and 644 ff.). 

^ See pp. lot f. 
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Board. The following institutions were represented on the Board: Ainlierst 
College, Boston University, Bowdoin College, Brown University, Darliuonth 
College, Mount Holyoke College, Smith College, Tnfls College, University 
of Maine, University of Vermont, Wellesley College, Wesleyan University, 
and Williams College. The function of the Board was to draw np a list of 
approved secondary schools from which students would be admitted to one 
of the constituent colleges without examination on the certification of the 
principals. 

To be placed upon the approved list schools were required to submit with 
their applications full information concerning their courses of study, teach- 
ers, and equipment. The preparation given in such schools had to follow one 
of the recognized plans for entering one of the colleges represented on the 
Board. Approval was granted to schools for periods of three years on the 
basis, first, of the records of their students who had already been aduiilted 
to the colleges, and, secondly, on the basis of the records of students admitted 
subsequent to the time of approval. As contrasted with the accrediting 
schemes the certification plan did not involve actual inspection of schools, 
but laid stress on the work of students from the approvi-d schools during 
their first year in the colleges concerned. 


Establishment op Examination Boards 

The issue was more acute in the Eastern states where each college had its 
own requirements for admission. Here the institutions of higher education 
were private and the same relations could not be established as in those 
states where both the universities and the high schools were provided and 
maintained by public authorities. Here the crucial issue was “to devise means 
for securing greater uniformity in college admission examinations.” A con- 
certed movement in this direction began in 1879 when an agreement was 
reached at a Conference of New England Colleges to accept the standards 
set by Harvard in the examination for English. This practice was extended 
to other subjects and in 1885 there was created the New England Associa- 
tion of Colleges and Preparatory Schools for “the advancement of the cause 
of liberal education by the promotion of interests common to colleges and 
preparatory schools.” The Association of Colleges and Secondary Schools of 
the Middle States and Maryland, which had already begun to meet in 1887, 
was formally established to carry out similar purposes. Out of these demands 
and movements toward uniform college entrance examinations there was es- 
tablished the College Entrance Examination Board, thus putting into effect 
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a proposal made as early as 1877 and frequently repeated thereafter by Presi- 
dent Eliot^ and carried through to success by President (then Professor) 
Nicholas Murray Butler. 

There was thus established an agency to conduct examinations in different 
parts of the country and abroad, and to award certificates to be accepted by 
college admission boards in lieu of their own separate admission examinations. 
The creation of the College Entrance Examination Board introduced no in- 
novation in the conduct of examinations; it merely responded to one of the 
demands already expressed by the Committee on College Entrance Require- 
ments “to study the question of college entrance examinations for the pur- 
pose of harmonizing the relations between the secondary schools and the 
colleges.”^ It was not the purpose of the Board to standardize secondary edu- 
cation throughout the country, bnt it did establish through its examinations 
standards and prescriptions for pupils who were planning. to enter certain 
colleges. To a certain extent standardization of high schools was promoted 
in many states by the accrediting system, in certain groups of states by 
regional standardizing agencies, and for the country as a whole through the 
reports of the Committee of Ten of the National Education Association 
(1893) and of the Committee on College Entrance Requirements (1895), which 
helped to create a national currency of norms in secondary education.® 

Regents’ Examinations in New York State 

The control of secondary education through examinations was nowhere as 
strict and direct as in New York State. Here the Board of Regents, estab- 
lished in 1784, began in 1865 to conduct preliminary examinations at the 
close of the elementary school course as a basis for the distribution of the 
Literature Fund. In 1878 the Board, in response to a request of the principals 
of academies undertook to examine secondary schools “for the purpose of 
measuring the work of the schools and establishing proper standards of 
scholarship” and to “furnish a suitable standard for graduation from acad- 
emies and academic departments of union schools, and of the admission to 
the several colleges of the State,” as well as for distribution of support from 
the Literature Fund.^ In 1900 the practice of paying grants on the basis of 

1 See C. W. Eliot, Educational Reform, p. 919 (New York, 1901). 

2 For the lesolutions of the Committee on College Entrance Requirements see E. C Bioome, A His- 
toi ical and Critical Discussion of ColUffs Admission Requirements, pp. 133 ff. (New York, 1909) 

^ See I L. Kandel, History of Secondanj Education, pp 469 ff. 

1 The influence of the Regents’ ExainmaLions upon the work of the schools cannot be discussed heie. 
An investigation by W W. Knox, A Study of Some of the Influences of Regents' Eraminatinns in 
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the examinations was changed and a return was made to payment on attend- 
ance and reports of inspectors. In 1906, however, the payment of grants was 
made dependent on the use of the Regents’ examinations but not on the re- 
sults. Beginning in 1880 the Board published syllabuses to furnish guidance 
to those schools which submitted pupils for the examinations. Discussing the 
practice in 1890 President Eliot admitted the “stimulating, elevating, and 
unifying influence of these examinations,” but criticized both the prepara- 
tion and the marking of the papers.^ 

The examination papers were prepared by a staff of inspectors and exam- 
iners under the direction of the secretary of the Board until 1906, when the 
cooperation of the schools and teachers was secured in their preparation. 
Ib'om this time on papers in the major subjects have been prepared by com- 
mittees consisting of representatives from high schools and colleges aiul the 
state supervisors of the respective subjects. The papers so prepared are sub- 
mitted to critical examination for content and form by the editorial stall' of 
the State Department of Education, and then resubmitted for liual senil itiy 
to a Board of Revision, usually of seven members, appointed by the Stale 
Examinations Board, which was created by Dr. Andrew S. Draper, then 
State Commissioner of Education, and consists of twenty members- fifteen 
representing colleges, superintendents of schools, and high school teachers, 
and five representing the State Department. The Board of Regiuits, in shu fl- 
ing the policies of the State with reference to courses of study and oxaniina- 
tions has thus endeavored to utilize the experience and judgment of those 
actually engaged in teaching the prospective candidates for the examinations. 

In the preparation of the examinations the claim has been made since 1920 
that care is taken to test power, mastery, and comprehension rather than 
knowledge or the acquisition of facts, which place a premium on applica- 
tion^ and a good memory. 

The older methods of teaching were concerned largely with memory 
processes and the resulting tests were largely fact questions seeking to find 
out what the pupil had remembered of a given mass of information. Newer 
methods of teaching seek to train reason and judgment, are concerned with 
cause and effect, with the marshaling of evidence from which the pupil is to 

QhemisUy, concluded that the elfect of the system is to lead tcacheis to cinpliasuc lopu s in chernistiy 
stiessed in past examinations, to plan courses in accoidance with the syllabus icqnnements, to gi\e 
special attention to infenoi pupils who weie likely to fail m the examinations, and to introduce ni m 
topics only as they weie requned by the Regents (Unpublished clissei tation, Teacheis College Col- 
umbia Univeisity, 1933 ) ’ 

1 C. W. Ehot, Educational Reform, pp. 307 ff (New Yoik, 1901). 

^ To the extent that tests do measure application (industry) they would be desirable. 
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deduce conclusions, and seek to establish likenesses and differences, com- 
parisons and contrasts. The resulting tests, therefore, are largely thought 
questions measuring the pupils’ understanding and appreciation of the 
subject studied.^ 

In 1923 after some years of discussion the Department began to experi- 
ment with the new, objective, short answer type of examination in English 
grammar and silent reading; in 1924 about half of the questions in algebra 
and geometry were of the new type, and true-false and completion tests were 
included in the social science paper. It was felt, however, that care must be 
taken that, besides measuring only factual memory, efforts must be made to 
retain tests of power. In 1925 an experiment was conducted, under the direc- 
tion of Dr. Ben D Wood, in modern languages and physics. The regular 
three-hour examination was divided equally between the old and new type 
questions, or, as they are called in the Department’s reports, subjective and 
objective type questions. Dr. Wood’s report on the experiment was that, in 
comparison with the old type examinations taken at the same time, the new 
type tests were much superior in objectivity, reliability, and validity, and 
that, while the cost of preparing and printing the new type tests was higher, 
the cost for marking or rating the papers was lower. Dr. W. W. Coxe of the 
Board’s staff agreed with Dr. Wood on the general principles of the new type 
examinations but not on their superiority.^ 

Two reasons impelled the Board of Regents to adopt the new type exam- 
inations, even though only in part. The first was the criticism of the exami- 
nations and their results from the proponents of scientific measurement in 
education,'* and the second was the rapid increase in the number of papers to 
be marked without a corresponding increase in the number of examiners. By 
1929 the Board had come to the conclusion that the ideal examination is a 
combination of the new and old type of questions, one to measure factual 
knowledge, and the other mastery or ability to organize a mass of material 
and to present it in narrative or expository form; “one is a test of cumulative 
Imowledge, the other of assimilated knowledge.”^ Objective examinations 
have been gradually extended year by year and are now found in whole or in 

^ Umvei sity of the State of New Yoik, Bulletin to the Schools, Vol. 12, October 1, 1925, p. 19. See also 
Annual Reports of the Education Depot tment, 1923, p 05, and 192‘t, p 223. 

^ Annual Report, 1927, p, 47. Professor Ben D Wood’s report on the new type e.'caminations in niodern 
languages and physics was published under the title Nem York Et'pei iments with New-Type Modern 
Language Tests (New York, 1927) 

2 Joint Committee on Rural Schools. Rural School Survey of New Yoi K State, Vol. II. Administration 
and Supervision, Pait V, pp. 414 ff. (Ithaca, N, Y., 1923). 

* See Annual Report, 1929, Vol. I, p. 188; and Annual Repoit, 1933, Vol. I, p. 212. 
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part in practically all the subjects offered, the proportion varying soniewhal 
with the nature of the subject. 

The examination papers are marked fii’st by teachers or commit lees of 
teachers in the schools where they are written, so that the pupils might be 
said to have the advantage^ of having their papers marked by those who are 
familiar with their work. Detailed suggestions and instructions for marking, 
prepared with their cooperation, are issued to teachers. The passing papers, 
or, as they are called, the papers “claimed,” are forwarded to the State De- 
partment for rereading by the staff examiners assisted during the summer 
by more than one hundred and fifty experienced teachers who must be col- 
lege graduates and must have had more than three years of experience in 
teaching the subject in which they examine. Papers from schools with out- 
standing records on examinations and in inspectors’ reports are reviewctl by 
sampling, and only when the sampling reveals a failure to maintain stand- 
ards are all the papers reread. In cases where the marks are debatable the 
papers are given a further reading and no paper is rejcclcd until il has had a 
second reading, usually by a senior examiner or the supervisor. ‘bVll scholar- 
ship and pre-professional papers are read twice by dillVreul ('xammers and 
in case of material variation are given a third reading.” How formidable Ihe 
task of reading is may be gathered from the increase in the number of papers 
which rose from 1,126 in 1878 to 330,226 in 1920 and 1,117,516 in 193 L 

It is claimed for the Regents’ examinations that the method of preparing 
the examination questions guarantees close adaptation^ to the work actually 
done in the schools, and that this work is in turn guided by the syllabuses 
which are also the result of cooperation between officials of the State Depart- 
ment and the school teachers. A proposal made in 1923 to substitute a sys- 
tem of certification of pupils by the schools for the examinations was rejected 
on the ground that the examinations “afford a satisfactory means of main- 
taining proper scholastic standards, of improving the quality of teaching, 
and of providing a satisfactory method of admission to higher institutions.”^ 

In comparing the predictive value of new and old methods of admission to 
college. Dr. Ben D. Wood found that of four methods (Thorndike Intelli- 
gence Scores, Regents’ examinations. College Entrance Board, and second- 
ary school marks) the Regents’ examinations correlated nearly as high as the 

1 At the same time the disadvantage of having a gi eat variety of diffeient standaids which may lesult 
from an absence of unifoim qualifications for teachers must be recognized and admitted. The practice 
still leaves a large part of the responsibility foi securing umfoim standaids on the cenlrnl reviewing 
body, which may or may not be equal to the task. 

^ But not neccssai ily to the individual student who is able to go beyond the presci ibed requirements, 

® Qniversity of the State of New York, Bulletin to Schools, Vol. 13, October 1, 1935, p. 19. 
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Thorndike tests with marks obtained by students in their freshman and 
sophomore years in college, and considerably higher than the certification 
method on the basis of secondary school marks. Two important differences 
are to be noted, however, — ^first that the Regents’ examinations at the time 
of the comparison were still of the traditional, subjective type, while the 
Thorndike tests were of the new objective type, and, secondly, that the latter 
took only three hours, while the former required fifteen hours.^ 

The Regents’ examinations have always been the subject of criticism, at 
one time because of their effects upon the work of the school, but later and 
more persistently because of variations in results and consequent unrelia- 
bility. The later criticism coincided with the development of statistical 
measurements in education. Thus the Rural School Survey, which was pub- 
lished in 1923, pointed out that there were large variations in the percentage 
of failures from year to year in a given subject and among different subjects 
in a given year; that there were discrepancies between the percentage of 
papers “claimed” as of passing grade by the teachers and the percentage “ac- 
cepted” or finally passed by the examiners; that these discrepancies varied 
from year to year and from subject to subject; that the distribution of marks 
showed no consistency among themselves as to form and no consistent tend- 
ency to approximate the normal curve to be expected in the distribution of 
homogeneous groups; and, finally, that the ratings are not standardized or 
reliable. 

Despite the systematic efforts, conducted over a period of twenty-five 
years, to secure cooperation between examiners and teachers, the variations 
in results and discrepancies in standards continued. Thus in elementary 
algebra the range of papers “accepted” by the examiners was from 50 per 
cent in 1897 to above 75 per cent in 1907, and approximately 60 per cent in 
1920; in biology 85 per cent of the papers were “accepted” in 1907 and 52.5 
per cent in 1920 ; in physics the range of “accepted” papers was from 35 per 
cent to about 80 per cent in this period; and in American history from 25 per 
cent in 1898 to 86.4 per cent in 1920. Within these ranges there were marked 
fluctuations from one year to the next; in American history 25 per cent of 
the papers were passed in 1898 and 61 per cent in the following year; in 
physics 63 per cent were passed in 1898 as compared with 36 per cent in 

1 Ben D. Wood, Measurement in. Higher Education, pp. 86 ff {New York, 1933). On the other hand, 
Piofessor Paul Kruse after considering the same question, the predictive value of Regents’ examina- 
tions, stated at about the same time that “It seems fair to conclude that the Regents’ examinations 
serve no better than do teachers’ marks as measuies of fitness foi college, and that they probably serve 
less ■well.” See Joint Committee on Rural Schools, Rural School Survey of Hew York State, Vol. II, 
Administration and Supervision, pp. 456 ft'. (Ithaca, N. Y., 1923). 
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1897. In the same way there were great variations in any one year in the 
percentage “accepted” in the different subjects of the examinations; the 
range m 1920 was from 52.5 per cent in biology to 86.4 per cent in American 
history. According to the Rural School Survey of New York Slate 

We have here evidence that there is great variation either in the diffi- 
culty of the examinations from year to year and from subject to subject in 
terms of the percentage of pupils writing who achieve a passing grade, or 
great variation in the rating of the papers, or both.^ 

If the following assumptions are accepted, that the ability of pupils and of 
the teachers in a given year will not vary greatly, and that the subject matter 
taught will not vary greatly from year to year, then it might be e.xpected 
that the same percentage of pupils should achieve a passing grade in the 
various subjects of the school course, provided that the work is atljiisted to 
their needs. The results up to the time of the survey (in 1922) seemed lo show 
that chance played a large part in determining the percentage of pujiils who 
passed in any subject in a given year. 

Not only were the results as finally determined by the exiiminers variiible 
but they disagreed with the standards of the teachers, d'lie nverage differ- 
ence between the percentage of papers “claimed” as of passing slandard liy 
the teachers and the percentage “accepted” by the examiners over a jieriod 
of twenty-five years was 9.4 per cent, and in twelve subjecls 9.2 jicr cent." 

The experiments with new type tests began after these critical observations 
of the examination results over a period of twenty-five years were made. 
New type tests have been introduced since that time in more subjects and in 
larger proportions in each subject. It is interesting accordingly to compare 
the results (on p. 43) over a period of five years preceding the inquiry (1916- 
1920) with the results in the last five years (1931-1935). 

It is unfortunate that the results of the old and new type examinations 
are not separated in the reports; it would then be possible over a period of 
years to compare the reliability and validity of the two types. Since the gen- 
eral conditions have remained the same with one exception (the unparalleled 
increase in the number of pupils in the secondary schools), the relative stabil- 
ity of the results in the last quinquennium as compared with the period 
from 1916 to 1920 can hardly be attributed to improved techniques of mark- 
ing the subjective type of the examinations. Whether the new type tests arc 

1 Joint Committee on Ruial Schools, Rural School Sutvey of New York State, Vol I, p. 119 (Ithaca, 
N. Y., 1922). 

2 Joint Committee on Ruial Schools, Rural School Survey of New York State, Vol. II, pp. <139 ff and 
pp. 528 ff. 
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NEW YORK STATE REGENTS' EXAMINATIONS 
Peu Cent or Papers Written Acceptet) 



1016 

1017 

ms 

1919 

1920 

1031 

1932 

1033 

1931 

193S 

English 

80.1 

74.3 

78 3 

90 6 

81 6 

89 7 

91 0 

89 0 

88 5 

88 4 

Modem languages 

66.9 

60 9 

69 8 

73 8 

61 0 

86 0 

86 2 

80.3 

86 3 

89 8 

Latin 

71.4 

70 6 

75 1 

77 9 

73.6 

75.), 

75.6 

81. 3 

81.4 

83.2 

Mathematics 

6,7.8 

67 4 

68.7 

63.0 

00 5 

72.5 

69 8 

71. .3 

73.0 

72.7 

Science 

71.0 

72.5 

69 1 

65 3 

60 8 

83 4 

82 6 

86 2 

85 t 

79 9 

Histoiyi 

77.5 

81.7 

86 1 

82 2 

85 6 

85 6 

87.9 

87 .t 

85 8 

88 8 

Coinmeicial subjects 

61.9 

65.9 

73 5 

67 1. 

66.6 

80,7 

76.2 

77.9 

ro 4 

79 6 

Drawing ^ 

75.5 

75.1 

80.3 

82 6 

83.0 

81..() 

78 K 

51 3 

79 1 

83 8 

Music ^ 

75,9 

76.7 

78 2 

85.0 

71 6 

80 3 

81.1 

80 7 

73 3 

7S 1. 

Average 

72.2 70 6 73 9 73 7 

Pi.ii Cent or PAi-rns Claimed 

70 7 81.3 

Acoci'l'l D 

81 1 

~8‘J/r 

83.4 

“83A 


1016 

1917 

lOlS 

1919 

1920 

1031 

1932 

l')33 

1034 

7955 

English 

91.7 

87.4. 

90 2 

93.7 

93.2 

97.9 

98 4 

97.7 

98.1 

97 4 

Modem languages 

83.2 

79.5 

89.9 

99.9 

79.8 

97.9 

99.3 

98 7 

1)7.9 

98 6 

Latin 

92.0 

S8.3 

91.3 

92.8 

92.0 

95 1. 

96 5 

06 8 

96 6 

06 1 

Mathematics 

93.2 

93.2 

914. 

93 3 

89 6 

96 8 

96 4 

97.5 

06 1 

05 7 

Science 

87.8 

85.T 

83 7 

80 0 

77.7 

98 4 

98 4 

98 9 

98 1. 

07,9 

History 

90.0 

90 5 

93 2 

9t6 

93.8 

07.9 

9T.9 

97.5 

97.1 

08 2 

Commercial subjects 

83.3 

84 9 

88 8 

85 7 

84.7 

96.6 

91. 1 

95 0 

95 3 

06 4 

Di awing 

88.5 

96.0 

92 0 

94 3 

91 8 

98 1. 

88 0 

83 .; 

86 9 

93 6 

Music 

94 9 

91..9 

90 1 

94 3 

91.2 

91 6 

90 3 

90 0 

86 0 

91 8 

Average 

89.3 

87.9 

90 4 

90S 

88.8 

97 4 

97.3 

97 5 

97.0 

97.4 


responsible for the stability of the results, the data at present available do 
not afford an adequate basis for judgment any more than the percentage of 
passing marks is a relevant guide to the reliability or validity of the results. 
The question may well be asked, however, whether a system which involves 
the marking of more than a million papers can be justified when the ratings 
of teachers and examiners are only less than three per cent from attaining 
perfect agreement. If the approximation in ratings is due to the increase of 
objective tests in the examination, there may well be found here a sound 
argument for the abandonment of a system which yields so little. The time 
and energy now devoted to the mechanics and administration of the exam- 
ination system may well be used for a more extensive scheme of constructive 
inspection, one of the functions of which would be to see that the educational 
values which undoubtedly inhere in the essay type of examination are not 
neglected. 


The College Entbance Examination Board 

The College Entrance Examination Board, unlike the Board of Regents of 
New York State, was established in 1900 as a voluntary organization in 

^ History was included under Social Studie*? m the latei period, 

2 Diawmg later was listed as Comprehensive Art, and Music as Comprehensive Music. 
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which representatives of secondary schools and colleges conhl cooperaLe to 
harmonize the relations between secondary schools and colleges, to eouduet 
examinations, and to award certificates on the basis of which colleges would 
admit applicants. It was not intended by the institution of these examina' 
tions to prescribe or limit the work of the secondary schools or the require- 
ments for admission to colleges so much as to establish certain recognized 
standards in both these fields. President Butler, who with President Eliot 
had been most influential in the creation of the Board, thus defined the 
Board’s functions after fourteen years of its history ; 

It goes without saying that the college admission examination is not an 
end in itself, but only a means. It is one of several means — but, I think, an 
indispensable one — of ascertaining whether a given student is fitted to 
enter a college and to profit by college instruction and college training. If 
the Board is able, as I confidently believe it will be, to proceed for another 
decade on its present lines, it will have brought about every whc're a new 
spirit of comity and cooperation between secondary school and college 
teachers, and a new and very helpful understanding of the jn-oblems wliicli 
attend the training of boys and girls who are aboul lo be gi’adualed from 
secondary schools.^ 

In the formal announcement of the organization of (he Board it was slated 
that “the manifest advantages of the examinations held by the Board” were 
uniformity in subject matter and administration; couvenicuce to Ihe candi- 
dates since they were to be conducted at one and the same time at many 
local centers; cooperation between schools and colleges without sacrifice of 
individuality; definition of uniform standards for secondary school work; and 
economy of time, money, and effort in administering college admission re- 
quirements.^ The Board was authorized by its Plan of Organization and Con- 
stitution 

to adopt and publish a statement of the ground which should be covered 
and of the aims which should be sought by secondary school teaching in 
each of the following subjects (and in such others as may be desirable), 
and a plan of examination suitable as a test for admission to college: 
Botany, chemistry, English, French, Greek, history, Latin, mathematics, 
physics, zoology.® 

During the first few years following the introduction of the examinations the 

1 College Entrance Examination Boaid, The Woik of the College Bntiance E-vamination Board, 1901- 
1925, p. 131 (New York, 1996). 

Ibid,, p. IS. 

® Ibid., p. 73. 
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Board did not formulate its own requirements but adopted those of existing 
authoritative organizations, such as the Conference on Uniform Entrance 
Requirements in English, the American Historical Association in history, 
the American Philological Association in Latin and Greek, the Modern Lan- 
guage Association in modern languages, and Committees of the National Edu- 
cation Association in mathematics and sciences. On the basis of these re- 
quirements “examination questions or other appropriate tests” were pre- 
pared in each subject by committees of three examiners (a college teacher as 
chief examiner, assisted by one college and one secondary school teacher as 
associate examiners) and submitted for approval or revision to a Committee 
of Revision consisting of the chief examiners and the five representatives of 
secondary schools on the Board. A passing mark of 60 on a scale of 100 was 
set with the provision that no paper was to be finally marked below SO with- 
out a second reading. The actual marking of papers was simple as long as the 
number of candidates was relatively small (973 at the first examination in 
1901); the several groups of readers studied the questions in their subjects 
and a common standard of marldng was reached after a specimen paper was 
read aloud. 

It was soon recognized that to rely on the requirements defined by the 
national associations was unsatisfactory, since the committees which formu- 
lated them were in the main not familiar with the standards to be expected 
at the secondary school level and were disbanded after they had defined the 
requirements. In order to provide for continuous study of the working of the 
requirements and for introducing such changes and modifications as might 
prove desirable a Committee of Review was created in 1907 not itself to 
formulate the requirements but to supervise their formulation and revision 
by specially appointed subject committees of college and secondary school 
teachers. Such requirements as might be recommended by the committees 
were not to be adopted by the Board until they had been submitted to schools 
and colleges for consideration and criticism and all objections had in the 
opinion of the Committee of Review been eliminated. Every effort was thus 
made to secure the cooperation of all concerned in the examination to estab- 
lish acceptable standards in the formulation of the requirements. It should 
be noted further that the Board began to publish examination questions early 
in its history and supplemented these later with the publication of Suggestions 
and Aids for College Candidates in various subjects and Specimen Answers of 
College Candidates in English, history, and plane geometry, reproducing an- 
swers with marks assigned to them. 

More difficult than this task, however, was that of setting uniform stand- 
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ai'ds of niai'king in the different subjects. To this eiul a coiderence oi (ho 
chief readers in each of the subjects was held during the week preceding the 
examinations in June, 1908, “with a view to securing the great esl uniforniily 
of method and point of view in the rating of the answer books.” The results 
in the examinations of 1909, when 62 per cent of the candidates in Latin 
were marked below 60 and more than half of the candidates in other sub- 
jects received less than this passing mark, led in 1910 to the establishment 
of a Committee on Examination Ratings to unify and systematize the read- 
ing and to act as a clearing house for complaints. The function of the Com- 
mittee was to receive detailed reports from the chief readers describing the 
methods employed, the results obtained, and the comments of the individual 
readers. On the basis of information so submitted the Committee was to 
make suggestions for increasing the accuracy and efficiency both in reading 
and marking papers and for securing the cooperation of the readi'rs in cases 
of difficulty. To this end the Committee was authorized to conduct confer- 
ences of the chief readers and of the readers in the different stibjeels, but tlu' 
responsibility was placed on the chief readers to see that the marking was 
not performed mechanically but in a spirit of fairness and jusl ice I o 1 he can- 
didates. Finally, it became the duty of the Committee to study the records 
of each examination, and, if the results were not satisfactory, UvS for a long 
time in the case of history, or if they showed marked fluctuations from yc'ar 
to year, as in mathematics, to discover the reasons. 

The Committee on Examination Ratings reported to the Board in 1911 its 
opinion that unsatisfactory results were due to distinctly difficult questions 
and to the fact that the examinations were taken in many cases by candi- 
dates who were utterly unprepared or very badly taught, or who were unable 
to secure certificates from their own schools and took the examinations as a 
forlorn hope. The Committee recommended that the chief readers be given 
greater authority and responsibility, that through conferences, before the 
reading of papers is begun, they agree on general principles of procedure 
to bring about greater unity of work, and that the readers be instructed 
“to use discretion and to mark the books according to a standard of fairness 
and common sense, rather than on a strictly mechanical basis” when they 
found the examinations too long for the time allowed or the questions un- 
reasonable. 

The precautions taken to eliminate carelessness, unfairness, and mistakes 
may be illustrated by the report of the chief reader in history for 1914. Ques- 
tions were prepared by each member of the committee of examiners in the 
fall, and were submitted for criticism to the other examiners; the criticisms 
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were returned and used as the basis for the preparation of a second paper. 
On the basis of the second papers a trial paper was constructed by the chief 
examiner, submitted for criticism, and a final paper prepared at a conference 
of all the examiners. As far as possible no question was admitted which was 
not dealt with in the customary textboolcs. The questions for 1914 were also 
passed upon by the Committee of Revision, consisting of the chief examiners 
in all subjects and secondary school representatives appointed by a num- 
ber of standardizing and accrediting agencies. For purposes of marking the 
examination papers the committee of fifteen readers was divided into four 
small groups, each reader marking the same five or six papers in order to 
maintain a common standard; every paper marked between 65 and 35 was 
read twice by one college and one secondary school teacher and a final mark 
assigned after discussion between the two. The function of the chief reader 
was to be present at the discussion by each group before a standard was 
agreed upon, to watch for too high or too low marks, to reread debatable 
papers, to settle doubtful points, and to supervise the marking in general. 

The same meticulousness was developed and became the established prac- 
tice in marliing examination papers in all subjects, — study of the questions, 
determination of numerical values, discussion of types of possible answers, 
reading, marking, and commenting upon a number of specimen papers, read- 
ing some of the most typical papers aloud and discussion by the whole group, 
pairing readers in doubtful cases, and submission of cases of disagreement to 
the chief reader. But even these methods did not always succeed in eliminat- 
ing the difficulties of reliable marking, particularly in the case of inexpe- 
rienced readers, as was illustrated in the report of the chief reader in geometry 
in 1922- 

There was one strildng case to illustrate the danger of over-confidence in 
any routine system of grading. A book to which one of the inexperienced 
readers had given a rating of 33 was referred to the committee on hopeless 
failures. They succeeded in discovering a considerable amount of sound 
sense behind a smoke-screen of confusing mistakes, and the grade was 
finally raised to 67 It was an extreme case on both sides. The original 
mark was too low, because the first reader, proceeding with routine speed, 
had quite pardonably overlooked a certain amount of meaning which was 
fairly elfectually concealed. The final mark was undoubtedly too high, be- 
cause it gave the candidate the benefit of the doubt on a number of points, 
in some instances surely beyond his deserts. On the knowledge of geometry 
shown, the candidate probably deserved to pass, and it did not seem to be 
worth while to spend more Lime in debating his numerical score. A few 
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other instances, perhaps a dozen among the thousands of books road, 
showed that re-reading docs eliminate some serious eri-orsd 

In the light of twenty-four years of experience with the examinations con- 
ducted by the Board, its secretary. Professor Thomas S. Fiske, analyzed 
their purposes as follows: 

The Board undertakes to ascertain in regard to the boys and girls wishing 
to enter college not merely whether they have stored m their memories the 
contents of the textbooks in general use but primarily whether they have 
made a start, have actually gone a little distance on the road from child- 
hood to intellectual maturity. 

Up to the present time the examinations of the College Entrance Exam- 
ination Board have been, above all, a test of the following qualities. — 
(1) Power of expression; (2) Intelligent appreciation; (3) Ability to reassem- 
ble information; (4) Courage to form and express independent judgmeuls; 
(6) Concentration, or power to sustain a mental effort. The Board has a I all 
times accepted the principle that it was its province to test I ho individual 
candidates in respect to certain clearly defined abilities or act[uirem<'nls, 
leaving it to the several universities, colleges, and scioutifio schools im- 
mediately concerned to administer such supplementary losls as should 
seem to them necessary or desirable.^ 

The examinations of the Board cannot, in other words, be acce 2 )Led as lh(! 
sole evidence of fitness to profit by college education, but the colleges can 
and do supplement the standing of candidates in these examinations with 
other records obtained from the schools which they attended, such as re- 
ports on ethical behavior, physical health, powers of observation, mental 

COLLEGE ENTRANCE EXAMINATION BOARD 
Results or Examinations duiung Decade 1910-1E)19^ 


Subject 

Number of 
Answer Bools 

Percentage of Books 
Rated 60-100 

Greek 

8,048 

66.1 

French 

31,602 

61.9 

Latin 

71,496 

58.1 

Physics 

11,079 

54.9 

Chemisti y 

6,441 

52.1 

Mathematics 

78,232 

51.1 

German 

23,207 

49 7 

English 

44,136 

45.2 

History 

28,536 

35.9 

All Subjects 

307,865 

52. S 


1 Ibid., p. 192. 

2 Ibid,, p. 209. 
Ibid., p. ler 
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alertness, ability to participate successfully in cooperative efforts, or team 
work, slGll in laboratory work, and facility in conversation in foreign lan- 
guages.^ 

In 1920 a disturbing factor began to be recognized and to be given serious 
attention — fluctuations in the results of examinations. The results of exam- 
inations during the decade 1910-1919 showed obvious fluctuations in results 
in different subjects which were as shown in the table on page 48. 

The percentage of examination books rated 60-100 in the different sub- 
jects for the five-year period from 1916 to 1921 was as shown in the following 
table: 


COLLEGE ENTRAE'GE EXAMINATION BOARD 
Pehcentaoe of Books Raied 60-100 at OiiDisAnv Examinations^ 



Euhgect 

laie 

1917 

19JS 

1910 

mo 

English 







A. 

Reading 


. 


• 

51,7 

B 

Study 





39 4 

AB. 

Reading and Study 





16 8 

1 

Giammai and Composition 

40.7 

42 1 

54.8 

al. 1 


3. 

Liteiatme 

43.2 

35.4 

•1.1.6 

50.6 

57,3 

History 







A 

Ancient 

.36.7 

37,3 

35.2 

33,9 

36.9 

B. 

Medieval and Modern 

22.7 

32 2 

35 6 

95.1 

43 5 

C 

Modem 



50 0 

44 3 

14.6 

D. 

English 

23.5 

42.4 

46 5 

35 6 

44.4 

E. 

A mei lean 

.... 




39.7 

F 

Civil Government 

16.9 

47.7 

S6.5 

46.0 

44 1 

G. 

American History and Civil Government 

21.0 

50.4 

38.6 

34.4 

49.2 

Latin 







1. 

Grammar 

58 1 

57 6 

43.9 

43.8 

40.6 

9. 

Elementary Composition 

64.8 

58.2 

57 5 

69.4 

65 5 

3. 

Second Y ear 

68,5 

50 6 

71.1 

60.6 

69 3 

4.. 

Ciceio and Sight Reading 

57 3 

58.6 

61.8 

58.1 

50.7 

124. 

Latin 1, 3, and 4 combined 


54.9 

55.4 

53.6 

43.3 

5 

Virgil and Sight Reading 

75.9 

68 2 

59.8 

62.2 

57 6 

6. 

Advanced Composition 

56.3 

55 1 

58.5 

64.0 

57.2 

P. 

Sight Transiation of Prose 

12.5 

40.9 

49.0 

62.6 

54 8 

Q. 

Sight Translation of Poctiy 

33.3 

83.5 

42.9 

75.6 

71.2 

Greet, 







Al. 

Grammar 

33.0 

58.3 

51 8 

69.8 

51.1 

A2. 

Elementary Prose Composition 

47.8 

71.7 

57.8 

72.3 

66.3 

B. 

Xenophon (Anaba.sis I-IV) 

60.3 

66 7 

46 4 

38.9 

50.0 

C 

Homer (Iliad I— III) 

58 7 

68.3 

76 6 

81.2 

96 4 

F. 

Prose Composition 

48.8 

56 2 

71 4 

80.0 

57.1 

G. 

Sight Transiation of Prose 

57 5 

100.0 

60.0 

100.0 

33.3 

BG. 

Xenophon and Sight Prose 

76.1 

83 7 

85 0 

86.6 

69.1 

CH. 

Homer and Sight Poeti y 

74.6 

77.2 

82.9 

93.2 

96.7 


1 JMd, p. 191. 

^ College Entrance Examination Board, Twentieth Annual Report^ pp. 25 f. (New York, 1930), 
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Subject 

1916 

1011 

19 U 

1019 

mo 

Fi ench 

A. 

Elemental y 

75.0 

51) 7 

59 5 

68.2 

(>7 9 

B. 

Intermediate 

73 a 

<1.2 3 

.5 (. 6 

60 7 

58 'i 

BC 

Intermediate and Advanced 

1.1.3 

56.1 

53 1 

53. 5 

61 1 

German 

A. 

Elementary 

55.3 

41) 8 

50 <) 

19 2 

67,1. 

B. 

Intermediate 

dO.ti 

35.9 

37.5 

37 1) 

70.5 

BC. 

Intel mediate and Advanced 

47.1 

55.1 

43 5 

52.6 

71 1 

Spani'ih 

Mathematics 

23.8 

39.3 

47.7 

50 2 

57 7 

A. 

Elementary Algebra 

38.2 

63 3 

74.7 

38.7 

73 9 

Al. 

Algebra to Quadratics 

SI 5 

57.8 

46 0 

34.6 

52.8 

A2. 

Quadratics and Beyond 

46.1 

57 8 

80.5 

46 6 

80 8 

B. 

Advanced Algebra 

38 2 

74.3 

65.5 

50 8 

62.1) 

G. 

Plane Geometiy 

38.0 

60.6 

5.5.6 

35.5 

(S 1 5 

D. 

Solid Geometiy 

2G.1 

51.2 

58 3 

53.0 

62.2 

CD. 

Plane and Solid Geometry 


65 5 

'19.6 

31.9 

60,9 

E 

Trigonometi y 

60.8 

76.7 

61 1 

()9 9 

87 5 

F. 

Plane Tiigonometiy 

55.8 

53 2 

56 0 

,5(). 1. 

()8 6 

Biology 


48 3 

55.5 

•1.9 5 

.52,6 

63 3 

Botany 


70.8 

6!) ■(. 

.18 6 

Id. 2 

35 5 

Qhemistrii 

42.;{ 

50.9 

52 2 

49,5 

.59.7 

Vramng 


Ft eehand 

<13.0 

26. t 

25 9 

33.9 

25.5 


M echanual 

27.5 

3() ■! 

'1 1. 8 

:!li.5 

31.1 

Oeogiaphy 

.50 0 

3I..8 

18 1, 

3 1.8 

27,0 

Physics 


4!).8 

.5i).() 

52.9 

59.0 

,56.2 

Zoology 


62.5 

66.7 

50.0 

-17.3 

26,3 


The criticism of the fluctuations in the results of the oxamiuatious, once 
started, continued to disturb the Board for many years Efl'orls wo-c made to 
explain and to justify them. It was stated that the Board from the start had 
never intended to have a flxed passing mark but to leave to the colleges the 
decision on the acceptable minimum rating in each subject after the exam- 
inations had been held. Other suggested explanations were that with the con- 
stant increase in the number of candidates presenting themselves for the ex- 
aminations there were many who under the new educational conditions were 
not accustomed to written examinations or were taking them for practice, or 
that fluctuations were due to variations in the quality of the candidates. 
After a time these explanations were discarded, and the “violent and regret- 
table fluctuations” were attributed to 

the unfortunate wording of one or more questions. The questions have 
occasionally been too long and complicated. Sometimes terms unfamiliar 
to the candidate have been employed. Sometimes the meaning of the 
troublesome question would have been obscure to anyone. Sometimes the 
question has been capable of two or more interpretations, one of which 
was not even suspected by the examiners. 
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On the language papers occasionally a passage has been set for trans- 
la Lion which has proved far too difficult for the candidates either by reason 
of unusual constructions or by reason of an unfamiliar vocabulary^ 

The fluctuations, it was claimed, were at any rate not due to variations in the 
standards of the readers who have long experience as teachers and readers 
with well-established standards based upon agreement reached by the differ- 
ent subject groups before the actual reading of papers is undertaken.* 

The charge that the examinations lacked reliability was met by raising the 
question whether a judgment of value in regard to reliability can be founded 
on the basis of a single examination, since so much depends upon the equality 
of questions in character and difficulty and the nature of the special topics 
selected and the mental characteristics (e.g. memory, imagination, alertness, 
power of concentration, etc.) stresscil by the examiners. Examination results 
are determined by a large number of factors, such as the following’ The can- 
didate’s effort or exertion to master the subject matter a.s presented by the 
teacher; the adequacy of the textbooks used and the competence of the 
teacher; the candidate’s memory, and logical power or ability to reason; his 
constructive or creative power; his power of expression and concentration; his 
intellectual alertness; and his facility in writing rapidly and m arranging his 
work neatly, depending upon experience acquired at previous examinations.® 
With reference to the correlation of examination results communications 
received from the schools concerned testified that the best pupils received 
the highest rating and the worst the lowest rating. 

If a candidate has attended a good secondary school, there is usually a 
high correlation between his school record and the results of his examina- 
tions with the College Entrance Examination Board. Practically all the 
secondary schools that make extensive use of the Board’s examinations 
testify to the fact that this correlation is high.'* 

1 The TForl, of the College Entrance Examination Board, 1001-192S, p. 2H. 

^ Professor L. T. Hopkins in a sludy on The Marking Sgttem of the College Entrance Examination 
Board, p. 11. (Cambridge, Mass., 1921), concluded that the assignment of marks fiom 1902 to 1990 
rarely appro'nmated the normal, even when only those pupils recommended by their schools as fully 
prepared took the examinations, nor were the results due to the mlliix of unprepared candidates The 
irregulaiitics were, he concluded, a very natural result of the method of reading and scoiing thepapers, 
the lack of standardization of values and corrections in conformity with the cuive of the error As the 
best basis for solving the difficulties Piofessor Hopkins suggested some approxmiatioii to the normal 
curve, since a certain uniformity m the dilfeicnt subjects should be expected. 

Ibid , pp. 179 f. 

■* Thirty-third Annual Report of the Secretary of the College Entrance Examination Bom d, p, 4 (New 
York, 1933). See also Thii tg-second Annual Report, wheie the fear is expressed that colleges may fol- 
low the logic of this coi relation and admit “without examination students who at the end of the high 
school couise stand in the uppei tenth, the uppei fifth, or the upper fourth of the class” (pp. 2 and 3). 
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Since it was the opinion of the Board that ilucluaLions wore duo to ihe 
character and form of the questions sel in the cxaininaLioiis, moasuros wore 
proposed in 1924 to lessen the fluctuations by the following suggoslod niotliods : 

(1) Material increase in the number of questions asked at an oxamiua- 
tion. (2) Better distribution of the questions over the whole hold covered 
by the requirement. (3) Exclusive use of questions previously lued out by 
experiment in secondary schools Another form of the last suggestion is 
the proposal that each group of examiners draw its exainmatiou ques- 
tions from a reservoir consisting of several thousand questions all of which 
have been tested by experiments in the secondary schools 

In a number of subjects undoubtedly the problem of lessening I he fluct na- 
tions in the results of the examinations would be solved most simply and 
most effectively by adopting more detailed and more precise deliiii lions of 
the requirements and by setting examinations strictly conforming thereto.^ 

Ten years later a Subcommittee on Questions of Policy which had been 
appointed in April, 1933, recommended 

that the existing definitions of the examination re((uirein('nl,s be lila'rally 
interpreted as indicating in a general way the nalure and exlcml of prepa- 
ration considered necessary and not as prescribing any dcliniU' form of in- 
struction, method of preparation, or teaching technicpie. 

It was suggested that examiners prepare their questions in such a way as “lo 
describe the individual candidate with the smallosl possible error of ineasnri'- 
ment,” the examining policies to be supervised, reviewed, and codrdinfil cd by 
a reconstituted Committee of Revision. This recommend a lion was based on 
the recognition by the Board that there is a problem of examiniug which 
needs to be solved by an analysis of the examinations subject by subject “in 
order to discover methods of increasing their validity and reliability.” J^^ur- 
ther, it was suggested that the examinations should not be used primarily to 
distinguish between those who pass and those who fail but as usable instru- 
ments for placement after entrance into college. The problem of fluctuations 
which still continued^ could be overcome by the Subcommittee’s recommen- 

1 The Worh of the College Entrance Examination Board, 1901-1925, p. 315. Tlie last pioposal would, of 
course, have been contraiy tothe original intention that the Boaid’s examinations should left am from 
assuming any kind of institutional control over the work of the secondary schools. 

2 In 1931 only 57.6 per cent of the candidates obtained marks above 60 in one of the French examina- 
tions as compared with 81.9 pei cent m the following year; in 1927 81.9 per cent leceived above 60 as 
compai ed with 52.8 per cent m the previous year “The complete tabulation of all vai lations m the pei - 
centage of answer books rated between 60 and 100 over a peiiod of years shows sinking variations in 
this proportion from year to year. In the face of such eccentiic results it seems moie conservative to 
assume that the populations are comparatively stable and that the examinations vary in ditliciilly I han 
to assume that the examinations are constant and that the selection of pupils and the quality of tlie 
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dation “to re-scale marks in all subjects so that these marks will be more true 
to form year in and year out.” The intention of this recommendation was 
that candidates should be arranged in the best possible order of merit with 
their reported marks. It is to be noted that the practice of grouping candi- 
dates in percentiles had been tried in 1922 but was pronounced futile in the 
following year because of the large number of papers marked 60. 

The new Committee on Revision was appointed in October, 1934, to “con- 
sider all phases of examinations including their relative importance and use, 
the advisability of continuing certain examinations, the type of examina- 
tions to be held, and their number.” It is difficult to anticipate the future 
trends which the Board will follow in the conduct of its examinations. That 
it has performed an important function and made a significant and much- 
needed contribution to the institution of acceptable standards in secondary 
education is clear. The last fifteen years of the history of the Board has been 
a period of external criticisms and internal self-investigation. This period has 
coincided with the more extensive development of tests and measurements, 
the application of statistical methods to problems of education, and an un- 
paralleled increase m the number of students in high schools and colleges 
New theories and philosophies of education, the result in part of changes in 
interpretation and psychology, and in part of rationalizations on the basis of 
the intellectual maladjustment of large numbers of students, have led to de- 
mands for greater flexibility in the range of studies provided and broader 
adaptations to individual differences of abilities and interests. Many colleges, 
which in the past jealously guarded the portals of admission, have shown a 
willingness to accept students on the basis of their secondary school records 
and the recommendations of their teachers.* Finally, e.xperiments have proved 
that aptitude tests, properly constructed, have greater reliability and higher 

prepaiation vary.” The R eeoramendatioas of the Subcommittee on Questions of Policy in the Thiity- 
fourth Annual Report of the Beoretarij of the Colhffe Entrance E eamination Boaid, p. 19 (New York, 
1934). 

1 Harvard, Yale, and Princeton conducted then own eiitiance examinations until 1915, when then 
repi esentatives requested the College Entiaiice Exaiiimation Boaid to piepare and conduct what came 
to be known as the New Plan and latci Plan B (m contrast to the Old Plan or Plan A) ex.iminatioiis. 
Undei Plan A candidates aie lequiiedto take enough examinations to make up a complete set of ad- 
mission requirements aggiegatmg hftcen points, under Plan B candidates who have an acceptable 
school vecnid aie excused fiom taking examinations in more than four subjects In 1919 a luimbei of 
women’s colleges — Bryn Mawi, Mount Holyoke, Smith, Vassal, and Wellesley — adopted the same 
plan. 

Many of these institutions have within the last few years mdicated then leadmess to dispense en- 
tirely with enhance examinations and to accept a percentage of candidates on the recommendations 
of their schools and then recoids On the predictive value of school lecords as compared with examina- 
tion results see A. D Whitman, Rahie of Eraminatiuns of the Colleye Entmnee Examination Board as 
Predictions of Success in College (New York, 1996). 
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predictive values than a series of examinations wliich lake llircx' or four 
times as long to write. To these facts should be added the opposition of pro- 
gressive educators to external examinations of any kind and ilio demand of a 
few secondary schools to be permitted to reorganize their curricula aiul 
courses of study without reference to examination requirements on condition 
that colleges would agree to admit their students on the recommendation of 
the schools.^ 

As a consequence of the rapid spread and use of psychological tests im- 
mediately after the War,^ the Board in 1922 and again in 1924 adopted the 
following resolutions : 

Resolved: That the College Entrance Examination Board regards with 
favorable interest the use of genei-al intelligence examinations as supple- 
ments to other examinations and stands ready to cooperate in giving gen- 
eral intelligence examinations as soon as giving such examuiations may be 
desired by college members of the Board and as soon as the same may be 
shown to be feasible. 

Resolved: That the Chairman of the Board be authorized to a])poiul, a 
commission to consider the question of the desire for inlelligcmce examina- 
tions and the feasibility of the proposal that the Board parlicii)al(' in their 
conduct.*' 

The Commission, appointed in 1924, reported that, on the basis of the fact 
that many colleges were already using psychological tests eit.her at entrance 
or afterward and following the opinions of leading psychologists, expressed 
itself as ready to recommend to the Board the establishment of psychological 
tests. A committee of experts was appointed in 1925 to prepare examination 
questions and instructions to supervisors, to score the answers, and to inter- 
pret the results. Accordingly in 1926 the Board for the first time adopted the 
use of “scholastic aptitude tests” but with the reservation that such tests 
should be supplementary only to other records of candidates for entrance to 
college. As explained by the committee of experts, appointed in 1925, 

Boards of Admission to colleges, now forced to estimate the future worth 
of candidates, need all the information which is available and pertinent to 
reach wise decisions. This additional test now made available through the 
instrumentality of the College Entrance Examination Board may help to 
resolve a few perplexing problems, but it should be regarded merely as a 


mV. M. Aikin, “The Pin poses of the Eight-Year Experimental Study.” jEduoational Recoul, Jaiuiaiy, 
193S, pp. 107 if 

^ See pp. 75 ff. below. 

^ 'The Work of the Colleye Entrance Examination Hoard, 1901-1925, p 219. 
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supplementary record. To place too great emphasis on test scores is as 
dangerous as the failure properly to evaluate any score or mark in con- 
junction with other measures and estimates which it supplements.^ 

The chairman of the committee of experts, Professor Carl C. Brigham, 
who in 1930 became Associate Secretary of the Board, in a subsequent re- 
port offered a further explanation of the policy of the Board in recommend- 
ing that the scholastic aptitude test be supplementary to other records. He 
pointed out that in the desire to eliminate some of the elements of unreliabil- 
ity by objectivity of scoring and to rate the individual more fairly “the ob- 
jective testers have plunged in with the individual rather than the institu- 
tional point of view.” In other words, they have neglected questions of the 
content of the curriculum, or the effect of examinations on the curriculum. 
Further, Professor Brigham argued that as recently as 1933 there were not 
available tests in controlled language composition, while in a subject such as 
science, tests “run counter to all legitimate purposes of science study.” Pro- 
fessor Brigham suggested that some of the virtues of objective tests could be 
incorporated in the old type examinations. Of these virtues he selected two, 
scaling of ejuestions in difficulty in such a way that every candidate can find 
his own level in a given amount of time, and heterogeneity in the use of 
larger numbers of questions so that subject matter might be sampled more 
widely and broader areas of information and reasoning be brought into play. 
The conflict to be settled was whether requirements for examinations should 
be defined as a form of institutional control or whether examinations should 
be used as devices for rating individuals. The problems confronting the Board 
must be studied experimentally in the same way as the Commission on Scho- 
lastic Aptitude Tests had attacked every phase of its problems experimen- 
tally. A new need has to be met which had not existed when the Board was 
first created and that is the provision of as much reliable information as 
could be secured about a candidate to be used not only for admission to col- 
lege but for his placement after admission. 

An organization set up for the sole purpose of collecting tickets at the 
gate is now asked to show people to their seats. The notion of a general ad- 
missions ticket is yielding to the notion of a more exact description of the 
individual which will make possible his proper placement in definable uni- 
verses of laiowledge.^ 


1 Ibid , pp. Ilf. 

^ Thirty-thnd Annual Report of the Secretniy of the College Enhance E caniination Board, pp 13 flf. 
The whole section is based on a report of the Associate Secretary to the EKecntive Committee of the 
Board, pp. 8 ff. 
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At present the rcsuHs of these coiisidernlions hiive been lo secure ;i com- 
promise between the new tind the old types of oxiiminidions, lo eneourage 
efforts to make the scoring as reliable and valid as possible, and to use the 
Scholastic Aptitude Tests to supplement the regular examinaliou. Following 
the Recommendations of the Subcommittee on Questions of Policy two com- 
missions were appointed to consider the problem of examining, one in history 
and the other in science. The first of these two commissions was appointetl 
to study the possibility of a comprehensive examination in history based 
upon a continuous four-year course and to consider the advisability of set- 
ting in each branch of history an examination consisting partly of objec- 
tive questions and partly of essay-type questions ^ 

The second commission was requested to consider the possibility of a com- 
prehensive examination upon a continuous four-year course in science anrl as 
alternative to the usual examination in physics a three-hour examination 
“devised to test the extent to which the student has brouglU to the euricli- 
ment of a study of physics the facts and pi-inciples learned in earlier si udie.s of 
biology, chemistry, or astronomy.” A Commission on Fxamiualioii.s in 
Mathematics had already been appointed in lOlld and in made reiiom- 
mendations looking to the construction of a new serien of exninhuilions lo 
test mathematical aptitude as well as mathemalical knowh'dge. 

These developments indicate a definite recognition of the existence of weak- 
nesses in the traditional system of examinations. The experiments uiion 
which the Board has embarked — the retention and improvement of the tra- 
ditional examination, the tentative introduction of objective tests, and the 
use of the Scholastic Aptitude Test— will in time provide a body of facts and 
information on the basis of which the Board may some day be in a position 
to abandon a caution, which may be laudable at the launching of new meth- 
ods, in favor of a plan which has stood a variety of tests. 

The problem of examinations as far as admission to the college from the 
secondary school is concerned has been clearly analyzed in the Thirty-third 
Annual Report oj the Secretary of the College Entrance Examination Board 
(pp. 3 ff.) : 

When a student arrives at the end of his course in the secondary school 
and applies for admission to college, those who are interested in his career 
are likely to ask themselves the following questions : 

1. How much has he leai-ned.^ 

2. How much more can he learn? 

3. How much more will he learn? 

Thirty-fourth Annual Report of the Secretaiy of the College Entrance Examination Board, p. 14. 
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The first of these questions may be answered by an examination, although 
the result may not throw light on a candidate’s “originality, imagination, 
or ability to meet a new situation.” The Scholastic Aptitude Test has for 
its purpose the discovery of a candidate’s power to learn, his power of con- 
centration, ability to comprehend or interpret, and other mental gifts. The 
third question. How much more will he learn?, cannot be answered reliably, 
because the answer depends on an individual’s character, habits, and incli- 
nations. 

In the opinion of many teachei-s it is fairly easy to find out how much a 
candidate has learned, somewhat difficult to find out how much more he 
can learn, and almost impossible to prophesy how much more he will learn. 

Thus after an experience of thirty-five years the conclusions of the Board 
coincide with the conclusions of those who have attacked the problem of ex- 
aminations by scientific, statistical methods. As will be shown in a later 
chapter there is general agreement among those who have employed these 
methods that no single test or measure has completely reliable predictive 
value, that any type of test must be supplemented by a carefully controlled 
system of cumulative records, and that guidance must be made an essential 
instrument of education, if students are to be expected to work in accordance 
with the indications of tests as to their abilities and powers of growth.’- 

Later Criticisms of Examinations 
AND THE “Scientific Movement” in Education 
At the opening of the century discussions on examinations were still on 
the basis of opinions. Those who favored examinations claimed that they 
had an educational value of a high order. As a test of power, it was argued, 
preparation for examinations trained students to deal with new material, 
to discriminate between the important and the unimportant, to appreciate 
the relations of hitherto unrelated details, to grasp a subject as a whole and 
to combine parts into a vital organic unity, to hold knowledge ready “on 
demand,” to think for oneself. Through examinations the teacher obtained a 
most impartial estimate of what a student knew, and the student discov- 


1 The effect of examinations like those of the Regents and College Entiance Examination Board upon 
the ivoik of the secondaiy schools, the extent to which they mtluence standards, and the degree to 
which they advance oi retard progiess in the levision of subject matter content has not been considered 
here. This aspect of examinations has been discussed by L II. Whitcraft, Some Iiijiitenres of the Re- 
quirements of the College Entiance Examination Board on Mathematics in Secondary Schools of the 
United States (New York, 1933), and W. W. Knox, A Study of Some of the Influences of Regents Ex- 
aminations in Chemist! y (Albany, N Y., 1933). 
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ered what he had really mastered. The timid student acquired coundenee and 
the conceited student gained humility.^ 

On the other hand, it was admitted that, while examinal ions are a grt'al aid 
in forming habits of mind which tend to make students more accurate, 
thorough, and clear, they may prove a great curse in selling up false stand- 
ards. Unless examinations are relegated to their proper place, they encourage 
cramming and discourage the formation of good habits of work. They could 
be put in their proper place as a method in training to study, if a student 
were told that at no stage is success in passing to be the sole test for promo- 
tion or admission to college, “regardless of the quality of his previous work 
or of the method of his preparation.” College admission should be based on 
examinations and student records as reported by the teachers; otherwise ('x- 
aminations tend to crowd the curriculum and are barbarous and worrying 
for the well-prepared student.^ 

President Arthur T. Hadley of Yale University argued nol for Ihe elimi- 
nation of examinations but for their improvement . Examinations should ful- 
fill two functions, one looking to the pa.sl — a stocktaking, as it were, of wliat 
the pupil has studied and mastered, and the other looking toward the future 
a test of power to go on. There is a danger, however, that examinal ions may 
test only memorization and not thinking or power. The probhun i.s to devis(' 
an examination which tests both knowledge and power, and at the same lime 
does not deprive the schools of their freedom. It might be solved by making 
the range of questions wider, by supplementing the examination with other 
tests, as, for example, the scrutiny of notebooks and other previous work, 
and by utilizing the teachers’ recommendations. The abandonment of the 
examinations would remove a stimulus and standards for work. President 
Hadley suggests a combination of methods, including an examination in es- 
sential foundations, such as English and mathematics; greater latitude in 
auxiliary subjects such as English literature and languages; and acceptance 
of certificates for studies necessary for general education. The tests of power 
to pursue further education should be in the hands of those who are to have 
the students, and the tests of attainment should be in the hands of those who 
have had them. There would still remain the problem of keeping instruction 
in the non-examined subjects up to standard, and of devising tests of power 
rather than of knowledge.^ 

Four years after this article appeared the traditional methods of discussing 

' Angie C. Chapin, “Examinations, an Apology.” Ed’ucational Renew, Vol. 90, 1900, pp. 519 ff. 

2 E. H. Nichols, “The Influence of Examinations.” Educational Review, Vol. 19, 1900, pp. 4 IS ff 

A. T. Hadley, “The Use and Control of Rxammationa.’' Ediioatwnal Review, Vol. 21, 1901, pp. 286 ft'. 
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examinations by exchange of opinions began to be attacked. In an article on 
“Examinations, Grades and Credits” Professor J. McKeen Cattell, who with 
his students at Columbia University had already begun to apply statistical 
methods to the study of human traits, threw out the following challenge, 
which laid the foundations for the subsequent study of the problem of exam- 
inations and still later for the development of objeetive methods of testing- 
In examinations and grades which attempt to determine individual dif- 
ferences and to select individuals for special purposes, it seems strange that 
no scientific study of any consequence has been made to del ermine the 
validity of our methods, to stamlardize and improve them. It is quite pos- 
sible that the assignment of grailes to school children and eollege .students 
as a kind of reward is useless or worse; its value could and should be deter- 
mined. But when students arc excluded from college because they do not 
secure a certain grade in a written examination, or when candidates for 
positions in government service are selected as a result of a written exam- 
ination, we assume a certain responsibility. The least that we can do is to 
make a scientific study of our methods and results.^ 

Professor Cattell, having in mind the recent creation of the College En- 
trance Examination Board, feared that the systematization of college en- 
trance examinations would be harmful to the schools, since 
It seems scarcely possible to determine whether students are fitted for a 
college course by means of a written examination. ... To devise and apply 
the best methods of determining fitness is the business of the psychological 
expert, who will probably represent at the close of this century as impor- 
tant a profession as medicine, law or church.^ 

The article then proceeded to discuss the distribution of grades on a normal 
curve. Professor J. Bendell Harris’s dispersion, and the need of standardizing 
grades. 

When Professor Cattell’s article appeared Professor Edward L. Thorndike 
was already at work in studying the reliability of marking in the examina- 
tions of the College Entrance Examination Board. While he welcomed the 
establishment of this Board because it made the practices of many colleges 
more efficient and instituted an authoritative body to make the relations 
between colleges and secondary schools more rational. Professor Thorndilce, 
on the basis of a study of the records of students at Columbia College who 
had been admitted on the results of the Board’s examinations in 1901, 1902, 

I J. McKeen Cattell, “Evaininations, Grades and Credits.” Papula) Scie)ice j\[oathhj, Vol 66, 1905, 
p. 367. 

- Ibid., pp. 368 and 369. 
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and 1903, showed Lhat “even so carefully managed exaininaLions as I hose arc 
extremely imperfect means of estimating an individuars fitness for college.” ‘ 
The investigation, conducted by Professor Thorndike, showed lhat suc- 
cess in college cannot be estimated with sufficient accuracy from the en- 
trance examinations. Although students may be admitted on the same aver- 
age mark, the average “in each case is based on a wide distribution of marks.” 
The estimate at the examination was wrong in 47 out of 50 cases as to suc- 
cess in the junior year. There were clear evidences that the entrance exami- 
nations were inadequate as measures of fitness for college. Thus a student 
might fail at one sitting and pass a few months or a year later as a result of 
coaching and not necessarily of capacity. In 150 repeated examinations the 
second mark for the same student showed a median difference of over 22 on 
a scale of 100, a difference greater than that between the marks of different 
students chosen at random. 

The entrance marks often utterly misi’eprescntcd the fitness of a student 
for college work. Ten students out of one hundred and thirty obtaiiu'd A’s in 
their junior year, although their average marks at entrance were in .some 
cases in the lowest tenth of the one hundred and thirty and barely above t lu' 
passing standard. If the passing grade had been slightly liiglnu', out' of llie 
very best students of the three college classes would have been excluded. Of 
those who failed a large percentage would have done belter than one-third 
of those admitted. From this Professor Thorndike concluded lhat 

Sooner or later there will be someone so barred out who would, if ad- 
mitted, have been the best man in his class. It is a moral atrocity to decide 
the fitness of an individual for college by a system which, when required to 
work to a moderate degree of accuracy, is wrong forty-seven times out of 
fifty. . . .[The traditional examinations] do not prevent incompetence from 
getting into college; do not prevent students of excellent promise from be- 
ing discouraged, improperly conditioned, or barred out altogether, do not 
measure fitness for college well enough to earn the respect of students or 
teachers; and do intolerable injustice to individuals. There is surely room 
for improvement.^ 

Professor Thorndike then proceeded to suggest a method which would be a 
positive force for selecting those who deserve further education, for promot- 
ing such cobperation with secondary schools as would improve conditions 
and quality of work, and for securing a rigorous, just, rational, and direct 

^ E. L. Thorndike, “The Fuluie of the College Enhance Examination Board ” Educatiorud Review, 
Vol. 31, 1906, p. 470. Another report on the same investigation appeared m Soienoe, Vol, 33, 100(1, pp. 
839 ff. 

2 Ibid., pp. 473 and 474. 
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measure of fitness for college. He recommended the accrediting of secondary 
schools on the basis of the actual success in college of candidates indorsed by 
the schools. Professor Thorndike’s interest at the time of writing this article 
was, as it is at the present time, both in the technical aspects of examinations 
as well as in their social implications. 

It is more important, he wrote, to give advanced education to one boy 
who most needs it, can profit most by it, use it in the world’s service than 
to prevent from entering upon it a hundred boys who are not able to meas- 
ure up to its demands. ‘ 

Expehiments in the Reliability oe Marking 
Both Cattell and Thorndilce expressed doubts on the validity of entrance 
examinations to select students for college; meviLably they cast suspicion 
also on the reliability of marking. The reliability of marking or grading in 
general was made the subject of investigation by Professors D. Starch and 
E. C. Elliott, who undertook to determine the range and variation, and the 
reliability of marks assigned by teachers to examination papers written by 
high school students in English, mathematics, and history. The experiment 
aimed to eliminate as many causes of variability as possible by having the 
same paper marked independently by different teachers. English was selected 
for the first experiment because it was thought that personal differences were 
more apt to appear in estimating the merits of a long paper. Two answer 
papers written by two pupils at the end of the first year’s work in English 
in one of the largest high schools in Wisconsin were reproduced on the same 
kind of paper as the original with the handwriting, errors, changes, neat- 
ness, etc., and sent with copies of the questions to 200 high schools of the 
North Central Association with the request that they be graded by the prin- 
cipal teacher of first-year English according to his usual practices and stand- 
ards. One hundred and fifty-two returns were made but for various reasons ten 
had to be discarded. Of the remainder 51 schools used 70 and 91 used 75 as the 
passing grade. The general results of this investigation showed a wide range 
of variation of as much as 35 or 40 points. Thus one of the two papers, B, 
which had been given a rating of five points above the passing mark of 70, 
was failed by 22 out of the 142 examiners; this paper was marked on the 
average eight points lower than the other. A, yet 19 out of the 142 examiners 
marked it higher and 23 marked it fifteen or more points lower. The range of 
marks for paper B, the poorer of the two, was somewhat wider than the 

1 Ihid , p, 475. Compaie with this his statement at the close of an article on “The Distiibution of Edu- 
cation," School Iteciexo^ Vol. 40, 1939, pp. 335 if. 
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range for paper A. Teachers in small high schools fended lo mark the pa[)ers 
more leniently than teachers in the larger schools, but the range ol varialion 
remained the same. Students without teaching experience tended lo mark 
more generously than the teachers who participated in the experiment.^ 

In order to meet the objection that personal and subjective factors would 
tend to affect the marking of an English paper, another investigation of the 
same kind was conducted with papers in geometry on the assumption that 
such factors would be eliminated in marking papers in an exact science. As 
shown by the separate grades and the comments on each quesLioir care and 
attention were given to the marking, and yet the result was the same as in 
the earlier investigation — an extremely wide variation in the marks assigned, 
even more striking than on the English papers. The reason for this was that 
the succession of steps, the use of theorems and definitions, the nealne.ss of 
drawings, spelling, form, make-up and appearance of the papers, and e.s- 
pecially the relative value of each particular demonslration or definition were 
taken into account in estimating the value of the papers. Tdiere w('re found 
wide variations in standards in high .schools dlstribuled over a large area, 
and, finally, the marks for a single question varied about as widely as for a 
whole paper. 

A third investigation was conducted by Starch and Elliot I in still another 
subject — history, with the same result. The variation in marks and iheir 
range and distribution was almost identical in the three invi'sligations in 
English, mathematics, and history; the Probable Error (P.E.) was almost the 
same in all the subjects — 5.4 in English, 7.5 in mathematics, and 7.7 in 
history. 

The investigators concluded that variability of marks is a function of the 
examiner and the method of examination and not of the subject, and that 
such variability throws suspicion on the fairness and accuracy of existing 
methods of evaluating the quality of work done in the schools. Hence the 
following questions arose: What are the factors that produce such wide diver- 
gence in the evaluation of school work? and What can be done to secure 
greater uniformity and more objective reality? The answer to the first ques- 
tion was that there exists a difference of standards among difi'erent schools 
and different teachers, that teachers differ on the rela tive values to be placed 
upon the various elements of a paper, and that differences are due to sheer 

^ D. Stavch and E. C. Elliott, “Reliability of the Grading of High School Work in English.” Srhool 
Review, Vol. 20, 1912, pp. 442 If. 

2 D. Starch and E. C Elliott, “Reliability of Giadmg Woik in Mathematics ” Schml Reoiew, Vol. 21, 
1913, pp. 254 if. 
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inability to distinguish between closely allied degrees of merit. The answer 
to the second question was the proposal that scales with a definite number of 
steps be adopted and that a standard curve or table be prepared showing the 
number of times each particular step should be assigned in the long run. It 
was proposed, in other words, that for the traditional type of examinations 
there be substituted the use of standard tests and scales for measuring effi- 
ciency in all subjects, similar to the scales which had been recently developed 
in arithmetic, composition, and handwriting.^ 

These studies confirmed experimentally other investigations which had 
already been conducted and which showed the existence of great variations 
in marldng among teachers, schools, and colleges, a variation due to the sub- 
jective methods employed and the absence of objective standards. In 1908 
Professor Max Meyer published the distribution of marks assigned at the 
University of Missouri by forty different professors in different subjects and 
the variations in standards as indicated by the percentage of students re- 
ceiving marks of A, B, C, or F. Thus in philosophy 55 per cent of 623 stu- 
dents received A, 33 per cent B, 10 per cent C, and 2 per cent F, while in one 
chemistry course taken by 903 students only 1 per cent were assigned A, 11 
per cent B, 60 per cent C, and 28 per cent Professor W. F. Dearborn found 
similar discrepancies in the grading of students at the University of Wiscon- 
sin by forty -five instructors in seven subjects;®* he concluded that 

marks, representing as they do the teacher’s estimate of mental abilities of 
various sorts, may themselves be naturally distributed according to the 
same frequencies as are the abilities which they are designed to represent. 
In so far as the teacher’s judgment is correct and is made of a sufficiently 
large number of pupils, the frequency of the different marks given should 
be the same as in a “normal” distribution curve.'* 

At Cornell University it was found by I. E. Finkelstein that the same stu- 
dents in a year course received entirely different grades from the two in- 
structors who taught the course in each semester.'’ Further, as Starch found 
in an experiment conducted at the University of Wisconsin, the same teach- 


' D Starch and E. C. Elliott, “The Reliability of Grading Work in History." School Revieio, Vol. 21, 
1913, pp. 676 ff 

- M. Moyer, “The Grading of Students.” Science, Vol. 28, 1908, pp. 2-13 ff. 

^ W E Dearborn, School and University Grades. Bulletin of the Uiuveisity of Wisconsin, 1910, No. 
368. See also similar results in W T. Foster, Administration of the Oolleffe Cuinouliim., Ch, XIII 
(Boston, 1911). 

* Ibid., p. 10. 

“ I. E. Finlcelstein, The Mailing System in Theory and Piactice (Baltimoie, Md , 1913). 
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ers gave different marks wlicn they regraded their own papers wit honl knowl- 
edge of their former marks d 

Later studies only helped to confirm the results of the earlier investigations. 
Sandiford reports the result of regrading an essay on the same subject set by 
the English Department of the University of Toronto. “An essay which had 
secured a mark of 80 in one year was copied by a student in another year and 
handed in as his work. The mark given to it the second time was 89. A 
physics paper for a matriculation examination was passed around after two 
weeks of examining and marked by the various associate examiners in To- 
ronto; the range of marks given was from 50 to 70 with 60 as the passing 
mark. In another investigation reported by Sandiford 

A paper in Honour Matriculation History was scored 50 (60 less 10 for 
misspellings) by the examiners. This paper was untidy, illegible, and badly 
spelled, yet as a history paper it had some merit. It was copied out in fair 
handwriting and the mistakes in spelling corrected, but all other mistakes 
were retained. The rewritten paper was again sent to the' examiiH'rs and 
scored by them as a new paper. The mark given to it this second linu' was 
70 (70 less 0 mistakes for misspellings). We can only eoncluih' lhal the 
examiners were influenced in giving 10 marks le.ss than it appariMilly de- 
served by its general untidiness and illegibility. Tlii'y had, howevi'r, beiui 
instructed not to deduct marks for any of iheso extraneous I'aetors exet'pl 
spelling and for this a maximum of 10 marks was the limit.’' 

Finally, and without exhausting the list of studios on the reliability of 
marldug,"* as an answer to the question Quis cudodict ipaoH cuftfodott? in exam- 
inations Professor Ben D. Wood cites the following incident: 

The facts of a subjective scale are well illustrated in the following anecdote 
concerning the grading of history papers by a group of college professors 
of history in the summer of 1920. One of the five or six expert readers 
assigned to a certain group of history papers, after scoring a few, wrote out 
for his own convenience what he considered a model paper for the given 
set of questions. By some mischance this model fell into the hands of an- 
other reader who graded it in a perfectly bona fide fashion. The mark he 
assigned to it was below passing, and, in accordance with the custom, this 
model was rated by a number of other expert readers in order to ensure 


1 D. Staich, “Reliability and Distiibution of Grade.s.” Seienee, Vol. 38, 1!)13, jip. (130 ff. 

2 P. Sandifoid, Educational Psychology, p. 303 (New York, 1928). 

5 Ibid., pp. 304 f. 

* See foi further references F. J. Kelly, Teachers' Marks, Their Variahilitii and Standardizing (New 
York, 1914); and G. M. Ruch, The Improvement of the Wnllen Examination, Ch. HI (Clucaf;n, 1921)). 
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that it was properly marked. The marks assigned to it by these readers 
varied from 40 to 90.^ 

Four factors have been mentioned by Starch as possible explanations of 
the discrepancies found in the distribution of marks . 

(1) Differences in the standard of severity or leniency in different schools; 

(2) differences in the standard of severity or leniency of different teachers; 

(3) differences in credit or penalty assigned by different teachers to any 
given fact or error in a piece of work; and (4) minuteness of the discrim- 
ination between successive steps of merit or quality in a given scale of 
qualities.^ 

The effect of the sustained attacks on the reliability of examinations, com- 
ing as they did at the same time as cumulative evidences of the nature and 
distribution of mdividiial differences, expansion of enrollments in high schools 
and later in colleges, and movements to bring about changes in curricula and 
courses of study, was to bring the traditional type of examination and its 
marking into disrepute. Other reasons also tended to produce the same results. 
Examinations were criticized as being injurious to the health of pupils and 
leading to overstrain and worry. They become objectives in themselves and 
encourage cramming, memorization and faulty methods of study inconsist- 
ent with modern aims m education. The brief time allotted for examinations 
is responsible for careless use of English and poor handwriting. They are on 
the whole unnecessary and the time devoted to them could more profitably 
be used for more study, review, or recreation. And, finally, a good teacher can 
grade his pupils without examinations.^ On the technical side it has been 
argued that the traditional examinations yield inaccurate measures of the 
achievements of pupils, since the marking is affected by personal and sub- 
jective factors. The traditional examinations include only a few questions 
which are not of equal difficulty and whose weighting by teachers is sub- 
jective.^ Since the number of questions is small, the pupils are subjected to 
chance selection and preparation. The content of examinations, ambiguous, 
indefinite, and using catch questions, is not, it is claimed, in agreement with 
sound educational aims. Finally, the rate of work is neglected so that a true 

1 Ben D. Wood, “Measurement of College Woik.” Educational Administration and Sujrerohion, Vol. 
VII, 1931, pp. 301 ff. 

D. Starch, Educational Pujclwlogy, pp -ISS f (New York, 1920). 

C. W. Odell, Traditional Examinations and New Type Tests, pp. 10 ff (New York, 1938) 

1 R Coimn, m an arlicle on “Teachers’ Estimates of the Ability of Pupils” {School and Society, Vol 3, 
1916, pp. 67 ff ) reported a very wide variation in the ranking of twenty-three problems m order of 
difficulty by twenty teacheis; one problem which was consideied the easiest hy one teachci was i anked 
twenty-first in difficulty by another. 
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measure of the ability of pupils workin<v agiiinsl lime oaimol lie .seeuix'd/ 
In a Symposium on The Value of Exaininalions eoiulueled by the Joiinial 
of Edvcation^ in 1929 the opinion was expressed by a miniber of I he 
leading superintendents of education in the country that examinalions as a 
test for passing a course, for promotion, or for the award ot cerlifieales and 
diplomas should be discarded. Examinations — and the majority a{)peared to 
have the new type tests in mind — are valuable as teaching di'vices: to en- 
courage study and review, to enable pupils to acquire a grasj) of larger re- 
lationships, to test the attainment of pupils, and to help teachers to discoNaa- 
the strength and weaknesses in their pupils and to correct the latter. In a 
word the chief use of examinations is for purposes of diagnosing pupils’ diffi- 
culties, improving methods of instruction, and gnidanee. I’romotions .should 
be based on a combination of various methods — examinations, ri'cords, and 
teachers’ judgments. In all these discussions the referimei' was not t o exi ('rual 
examinations but to those conducted by teaelu'rs in their own classrooms. 

,v. f .« / 

Maricinq of Essay E.xamina'I'ions 

A few attempts have boon made to jirove that the traditional o.ssay type 
of examination can be so improveil both in form am! nudhods of marking as 
to yield more reliable results, but those attempts .semn t o ap])roximal o in gen- 
eral concept the new type tests in so far as they call for mori' ri'sl rh'l la 1 a iiswers 
to more specific questions. Provided the procedure both in formnhiting the 
questions and in marking is perfectly straightforward, it is ohdmoil that essay 
examinations may be marked with reliabilities of .80 and over, as (‘omjiaretl 
with reliabilities from .30 to .50 which are usual, and .70 and over which arc 
rare, where such care is not taken. Methods .should be used to restrict the 
answers to specific questions. But the suggestions that are offered on jiro- 
cedure do not differ from those already adopted by such examining bodies as 
the Regents or the College Entrance Examination Boards, that is, agreement 
on what the questions should be marked for, analysis of ideal answers, and 
assignment of a certain number of points to each significant part of a ques- 
tion. 

Thus in an article on “Reliable Reading of Essay Tests” the authors, J. M. 
and R. C. Stalnaker, conclude that 

If essay tests are to be used in achievement examinations (and because 
of the prevailing belief that they fulfil a function which objective tests do 

1 W. S. Moiiroe, W> Men Examinations and Their Improvement, pp. (0 ff. Uiuver.si(y of Illinois Bulle- 
tin, No. 9, 1922. 

2 Journal of Education, Vol. 119 (Boston, 1929). 
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not, there is every indication that they will be), reliable reading of them 
must be obtained Examinations will never be valid until they are reliably 
read. If care is taken to formulate essay-test questions in such a way that 
a restricted form of answer is required and if readers will judge papers on 
the basis of specific, predetermined criteria which (rial has shown can be 
consistently evaluated, there is no reason why reliability of reading cannot 
be measurably improved. Indeed, in Ihe reading of English cxaininalions 
at the University of Chicago the reliability has improved from .43 in 
October, 1931, to an average of .93 in November, 1933.^ 

The following examples are given by the authors of the formulation of ques- 
tions to secure a definite and restricted type of answers which should serve 
as measures not of ability to recall memorized facts but of a specific and nar- 
row ability. Instead of asking students to “Discuss the causes of the World 
War,” the answers to which it would be difficult to mark reliably, the ques- 
tion should be put in this way; “Discuss the causes of the World War with 
specific reference to (a) the alliances in 1914 and their effects; (b) the rival- 
ries of colonial expansion; (c) militarism in Germany; (d) . . . . etc.” Or again 
answers to a question in this form “Compare the writings of Corneille and 
Racme” can be marked less reliably than if the form were “Compare the 
writings of Corneille and Racine as to (a) modernity; (b) use of action; (c) 
observance of the unities, . . . etc.”^ Suggestive as these proposals are, 
they are approximations to the objective type of tests, which carry the process 
of analysis of content further. 

There still remains the argument m favor of the essay type of examination 
that it provides better evidence of understanding, reasoning, and ability to 
organize information than do the objective tests which, it is objected, meas- 
ure only knowledge of facts and information. Since this is the most common 
criticism of objective tests it will be dealt with later. Here it is only necessary 
to refer to one experiment on the results of essay and objective tests in the 
same subject (United States history) given to the same pupils. It was found 
in general that when an essay test and an objective test are carefully made 
and when the scoring of the essay examination is kept as objective as possi- 
ble, the tests have about equal merit in measuring the understanding of the 
pupils. While the differences in correlation of the two tests are in favor of the 
essay test as an instrument for measuring understanding, the differences are 


1 J. M. and R. C. Stalnaker, “Reliable Reading ot Essay Tests " School Review, Vol. 41, 103 1, pp. 
599 If. 

^ Ibid., p. 601. 
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small and are balanced by ibe time involved in Ihe consLruclion aiul mark- 
ing of the testsA 

The discussion of objective tests in a later chapter will show that those who 
have attacked the problem of constructing such tests intelligently and with 
insight into education have endeavored to meeL the challenge that objective 
tests measure reasoning as well as loiowledge of facts. The challenge is salu- 
tary, for there is a real danger that, because of the greater J’eliability and 
validity of sound objective tests, the educative value of writing essays and 
their value as a method of training in expression, in assembling materials, 
and in organizing them logically may be neglected, or, if not neglected, be 
relegated to classes in English composition alone. 


1 R. B, Weaver and A. B. Tiaxler, “Essay ExaimnaLions and Objective Tests in UniLed Slates History 
in the Junior High School.” School Remem, Vol. 39. 1931, pp. 689 ff 



CHAPTER III 

THE SCIENTIFIC ATTACK ON EXAMINATIONS 

Selection or Distribution in Education 

T he critical attack on the old type of examinations could not have pro- 
duced successful results had there not been developing, side by side 
with the statistical investigations into the reliability of marking, a movement 
for the construction of more scientifically accurate, reliable, and valid types 
of examinations which should at once eliminate the subjective factors and 
establish objectively measurable standards. Evidence had been accumulated 
that no amount of care in the marking of papers of the essay type — discus- 
sion of standards before the marking was undertaken, the reading of papers 
by two or more examiners, the distribution of students on a normal curve — 
could successfully eliminate the fallibility of subjective judgments. There 
was an additional factor which necessitated a system whereby the abilities 
of pupils and students could be more accurately judged, a factor which has 
only recently begun to make itself felt in European and other systems of edu- 
cation. This was the remarkable and unprecedented increase in the number 
of students flocking first into the high schools and later into the colleges. This 
increase which became more rapid in the last two decades inevitably raised 
the problem of discovering types of curricula and courses best suited to the 
ever- widening range of individual differences. If the high school and college 
were to be accessible to all who wished or were prepared to request admission, 
it became the inevitable task of educators to discover the kind of education 
from which individual students could best profit in accordance with their 
abilities. 

Admission to the public high school has never been selective, and increas- 
ingly selection for admission to state-maintained universities is beginning to 
disappear. While this tendency is inevitably accompanied by the danger of 
lowering standards^ or of catering to mediocrity, American educators are not 
altogether oblivious to this danger, and for two reasons. The first is that as 
contrasted with the European tradition there does not exist in American 
education as widespread and unwavering an acceptance of a somewhat rigid 
definition of culture or of scholarship. The American tradition represents 
sometimes a conflict between, sometimes a blending of the two traditions 


1 See I. L. Kandel, The Dilemma of Democracy (Carabudge, Mass., 1933), and .1. L. Tildsley, The 
Mounting ^YaHe of the Arne) ican Secondary School {Cambridge, Mass., 1938). 
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that have made American culture and civilization whal they arc: the West- 
ern tradition of a liberal education and the pragmatic tradition of the frontier. 
The second reason is the acceptance of the democratic principle of equality 
of educational opportunity which in contrast to earlier notions is gradually 
beginning to be defined as an opportunity to obtain that education from 
which the individual is most capable of profiting. Elasticity in the concept of 
a liberal or general education and the emphasis on individual ability and 
capacity are at once the result and the cause of the movement to establish 
more accurate measures of educability. 

Hence, while it is true that in its origin the attempt was made to discover 
more valid and reliable substitutes for the traditional examinations, there 
has gradually developed the recognition that the purpose of examinations of 
any kind should not be primarily to separate the sheep from the goats, to 
distinguish between those who should pass and those who should fail, but 
rather to discover the abilities of pupils and students and to provide for them 
the kind of education best suited to their abilities. To this purpose some con- 
tribution was made by applying to education some of the principles of effi- 
ciency which had been developed in industry and business. In so vast and 
costly an undertaking as the educational system, maintained and supjiorted 
by public taxation, the question presented itself in these forms : Is there any 
justification for maintaining such a system if a certain percentage of students 
fail.^ Should it not be the duty of educators to devise such forms of education 
as will prevent failure by adequate adjustments to the abilities of the pupils? 
Should not measures be taken to encourage persistence in schools or colleges? 
How much and what kind of education has an individual derived who leaves 
with a record of failures? Here again the statement must be repeated that 
tire American system of education unlike the European is neither competitive 
nor selective, nor has education in the past been associated with the idea of 
social status. 

It is perhaps not an exaggeration to say that some systems of education 
and many teachers seek to prove the maintenance of high standards by 
pointing to the large percentage of failures. In American education the present 
tendency is to regard failure as a criticism of the system. This tendency may 
be illustrated by a number of quotations; 

There arc no misfit children. Tiiere are misfit schools, misfit texts and 

studies, misfit dogmas and traditions of pedants and pedantry. There are 

misfit homes, misfit occupations and diversions. In fact there are all kinds 
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and traditions of misfit clothing for children, but — in the nature of things 
there can be no misfit children^ 

As well say a man does not fit his clothes as say the child does not fit 
the school. The child is the standard to which all other things must be ad- 
justed, and to the extent that this adjustment is imperfect, to that extent 
the school fails. ^ 

The duty of publicly supported educational institutions, especially those 
that operate under the compulsory attendance law, is to helj) all jmpils, 
whether they be geniuses, mediocrities or morons. To fail large masses of 
young people on the ground that they have not lived up to the minimum 
essentials of a predetermined curriculum is both a professional blunder 
and a social injustice. There is no way of adjusting the school except by 
studying the capacities, achievements, interests and needs of growing in- 
dividuals.^ 

A uniform standard of attainment for all secondary school boys and 
girls cannot be maintained. Standards should be determined for each in- 
dividual on the basis of his abilities and interests within the limits of social 
value 

In a system of education where growth and development are the key 
words, success is not to be measured primarily by the accumulation of 
credits and units, but by the degree and kind of growth along the lines of 
native capacity and individual needs. The word “failure” will have no 
place in a philosophy or scheme of education which is so gauged and 
measured. 

It naturally follows that certificates of graduation or diplomas will be 
granted to all who have made the growth possible for them over a given 
period of time. The degree of development would be indicated on the cer- 
tificate. To such as had grown in a certain direction and to a prescribed 
extent, the certificate would serve as a passport to institutions of higher 
learning. To others whose growth was of lesser extent or along other lines 
the certificate would stand as a symbol of recognition for accomplishment 
and it would prevent a sense of futility and frustration on the part of stu- 
dents who put forth honest efi’ort.* 

(1) Once a college has admitted a student it has a moral obligation to do 

1 F, Burli, In re Every Ohild, a Minor vs Lotlslep Schooling (San Fiancisco State Normal School, 
Monograph C, 1915). 

B. R. Buckingham, Research for Teachers, p. 999 (Chicago, 1926). 

* B D. Wood, loo. cit , p. 13. 

* Associated Academic Principals, New York State, Summary Report of the Committee on Secondary 
School Problems, p. 16 (1932). 

® California State Department of Education, Division of Secondary Education, Bulletin No C-9, Sep- 
tember, 1931, Quide for Oaunseltng in the Secondary School, pp. 30 f. 
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everything within reason to help him succeed. (2) The college is much 
more than an agency for providing academic instruction. (3) The college, 
peopled by anxious and perplexed adolescents, has an opportunity, and, 
what is more, a responsibility to help these youths resolve their insistent 
and portentous dilemmas.^ 

Although it is obvious that they (poor students) do not deserve, or 
rather that their lot will not be improved (and might be aggravated) by 
receiving passing grades in physics, it is the opinion of a growing number 
of educators that such students deserve something more constructive and 
helpful for their time and money than merely a failing grade. It is equally 
true that society deserves more for the time and money spent on such 
pupils than the mere stigmatizing of them as failures.^ 

The implications of these quotations have been summarized by Professor 
Hemy C. Morrison of the University of Chicago in the statement that “Teach- 
ers should spend half their time studying their pupils as individuals, and the 
rest of their Lime doing what that study shows to be desirable and necessary.® 
Examinations from the American point of view (in theory generally, in 
practice to some extent) have begun to be regarded as instruments and de- 

' W. H. Cowley, “The College Guarantees Satisfaction.” Educational Record, Januaiy, 1935, p, 20. 
^ F. Palmer, Jr. “The College Physics Testing Program.” Educational Record, January, 1935, p. 91. 

^ From the European point of view the question that is suggested by these quotations is how much of 
a genuine education is acquired by the non-valeui $ and the large percentage of students who fail in the 
French lycees and oolUges, oi those who fall under the second categoiy in Oeist und Torheit auf 
Primanerbdnlm by W. Hartnacke and E. Wohlfahit (Dresden, 193'1) m the German secondary schools, 
01 the 30 per cent of those who fail in the first secondary school examination in English secondary 
schools. 

The quotations given above may be paralleled by the address of Pi ofessor C. Delisle Burns at the 
Confeience on Examinations held at Eastbourne in 1931. The reader is referred to the whole address 
which will be found in the Confeience on Examinations, pages 226-234; to the quotation cited eailier 
I following may be added “It is important that we should discover, not merely how far 

the old-fashioned examination should go — and I do not think it goes very far for our modern needs — 
but also you must riot make success or failure in an old examination system, designed in an age which 
has gone, the test of me kind of person you need in the modern world. You need a new kind of exam- 
ination system, one based lather on the social assumption that you want distributions of functions 
within each section of society. It is much less impoitanl to See who is at the top and who is at the bot- 
om lere is no top and bottom leally; society is simply an interlocking of certain structures — almost 
organic structures— m legard to which you cannot say that one part of the structure is purely directive 
an e o lei par is purely instrumental. . . We therefore want new kinds of tests, and if we can 
discover the kinds ot test that will give us the sort of banker that is the best banker and the sort of 
in us ua is la is e best industrialist, and the soit of railwayman or railway manager that is the 
es rai wayman an rai way manager, the result will be that we shall save the educational system from 
(^*^23^')^*^ “-PS® us at of the Chinese educational system when the situation changed too rapidly” 

The statement of M. Ldon Brunschvieg, quoted on p. 16, carries implications of the same kind as 
r XT ^ ^ Commission Permanent de Selection et d' Orientation m the Ministiy 

0 a ova uca ion in France, and the discussions of the baccalaurdat in the French Committee’s 
report. La Correction des Epreuves Ecrites dans les Examens, Part I (Pans, 1936). 
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vices for guiding, advising, and placing students, and for these purposes the 
instruments have had to be made as accurate, reliable, and valid as possible. 
Further study, however, has indicated that no single examination or test of 
ability of any type can be relied upon as the sole device for the educational 
guidance of students Hence the research of the past two decades has been 
devoted to the perfection of all available measures of ability and attainment, 
and to the discovery of the land of information that is most needed about an 
individual in order to supplement existing measures and to yield the best 
diagnostic and prognostic results. It is perhaps not out of place to state that 
in the main, possibly because of the necessities of the situation, possibly be- 
cause of an expectation that the able student can take care of himself, more 
attention has been paid to the poorer and less able student. 

The Scientific Movement in Education 
The demands imposed upon educators by the conditions which from the 
beginning of the century were peculiarly American^ and the criticisms of the 
traditional practice of examinations coincided with, if they did not actually 
stimulate, the development of what has been called the scientific movement 
in education, that is, methods analogous to those employed in the physical 
sciences. Sir Francis Gallon in England and James McKeen Cattell in the 
United States had already begun before the close of the nineteenth century 
to experiment with the application of statistical methods to the measurement 
of human trails. Thus in 1890 Professor Cattell indicated the scope of the 
new methods in the following statement: 

Psychology cannot attain the certainty and exactness of the physical 
sciences, unless it rests on a foundation of experiment and measurement. 
A step in this direction could be made by applying a series of mental tests 
and measurements to a large number of individuals. The results would be 
of considerable scientific value in discovering the constancy of mental 
processes, their interdependence, and their variation under different cir- 
cumstances. Individuals, besides, would find their tests interesting, and, 
perhaps, useful in regard to training, mode of life or indication of disease. 
The scientific and practical value of such tests would be much increased 
should a uniform system be adopted, so that determinations made at dif- 
ferent times and places could be compared and combined,^ 

Sir Francis Gallon in his remarks on Cattell’s article made the following 

^ Somewhat similar conditions are imposing the same demands upon other systems of education in all 
parts of the world. 

2 J. McKeen Cattell, “Mental Tests and Measurements.” Mind,Vd\. XV, 1890, p, 373. 
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important addendum, which indicated the direction to be taken subsequently 
by the scientific movement in education • 

One of the most important objects of measurement is hardly if at all 
alluded to here and should be emphasized. It is to obtain a geuei-al knowl- 
edge of the capacities of a man by sinldng shafts, as it were, at a few 
critical points. In order to ascertain the best points for the purpose, the 
sets of measures should be compared with an independent estimate of the 
man’s powers. We thus may learn which of the measures are the most in- 
structive. The sort of estimates I have in view and which I would suggest 
should be noted (? for private use) is something of this kind — “mobile, 
eager, energetic; well-shaped; successful at games requiring good eye and 
hand; sensitive, good at music and drawing.” Such estimates would be far 
from worthless when made after only a few minutes’ talk; they ought to 
be exact when made of students who have been for months and years under 
observation.^ 


In the above-mentioned article Cattell proposed ten tests: dynamometer 
pressure, rate of movement, sensation areas, pressure causing pain, least 
noticeable differences in weight, reaction time for sound, time for naming 
colors, bisection of a 50 cm. line, judgment of ten seconds time, and number 
of letters remembered on one hearing. The methods of measuring sensory 
discrimination and rapidity of reaction, introduced and further expanded by 
Cattell and Farrand, were published in 1896, but while they were an impor- 
tant contribution on the technical side, their influence was still limited to 
laboratory experimentation. The more direct influence on the practical prob- 
lems of education came at about the same time from two directions — the ap- 
plication of statistical methods to education by Professor Edward L. Thorn- 
dike and the development of intelligence tests, primarily for subnormal 
children, elaborated by Binet and Simon. In 1904 Thorndike published his 
Introduction to the Theory oj Mental and Social Measurements; Binet’s scale 
of intelligence, first published in 1905, was introduced to the United States 
in 1908 by H. FI. Goddard, director of the psychological laboratory at the 
Training School for Feebleminded Children at Vineland, New Jersey. It is 
not necessary here to discuss the further development of intelligence tests, 
their revision, elaboration, and application to normal pupils.^ 

1 Sii Francis Galton, i6jd., p, 380. 


For this histoiy see National Society for the Study of Education, Seventeenth Yearbook, Part II, The 
Measurement of Educational Pioducts (Bloomington, 111., 1918), and Twenty-first Yeaibool, Part I, 
The NaWre, History, and General Principles of Intelligence Testing, and Part II, The Administrative 
Use of Intelligence Testing (Bloomington, 111 , 1922), R Pmtner, Intelligence Testing (New Yo.lc, 
U-3); and A. T. Wyh^ A Brief History of Mental Tests,” Teachers Gollege Record, Vol. XXIII, 
January, 1922, pp. 19 ff. j 
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While progress was being made with the development and improvement of 
techniques of measurement and statistical methods in general and educa- 
tional psychology, the foundations were beginning to be laid for the apjilica- 
tion of such methods to school subjects. In 1894 Dr. J. M. Rice undertook the 
preparation of standardized tests in school subjects, starting first with tests 
in spelling and extending later to tests in arithmetic and composition. The 
pioneer efforts of Rice did not carry conviction in the educational world until 
more exact standards of measurement began to be applied lo the problem by 
Thorndike and his students. The Antkmetic Teats of Stone (1008) and Lite 
Handwriting Scale of Thorndike (1909), because of their employment of more 
scientific procedures than were at the command of Rice, carried immediate 
conviction. From these early beginnings the development of standardized 
tests spread rapidly to other fields of instruction, first at the elementary, then 
at the secondary, and still later at the college level. 

There were thus available two instruments — the measurement of intelli- 
gence and the measurement of achievement in education — which were haded 
as the final solutions for providing the right education for the right pupil, for 
meeting all administrative problems in education (its appropriate distribu- 
tion, and the classification and selection of pupils and students, vocational 
and educational guidance, and the standardization of the educational pro- 
duct) , and for correcting the fallibility of traditional examinations. The hopes 
which were aroused by tests of intelligence were thus expressed by Professor 
R. Pintner’ 

Intelligence testing is of recent growth, and the accomplishments of the 
last fifteen years have been great. Nevertheless we stand merely at the 
beginning of an important chapter of human behavior. The future will see 
new and more accurate tests. It will see tests applied for purposes now 
unthought of. The types of individuals tested . . . will undoubtedly in- 
crease. A future edition of such a book as this may well have such chapter 
headings as “The Immigrant”; “The Voter”; “The Applicant for a Mar- 
riage License”; “The Candidate for Public Office”; “The Civil Servant”; 
and so forth. For intelligence is one of the aspects of an individual’s per- 
sonality that is of great importance in modern civilized life. And now that 
we are able to measure it with a fair degree of accuracy, intelligence tests 
will find a wider and wider field of application.^ 

These expectations were not only based on a characteristic tendency to 
accept mechanical devices in American education, but also in a larger meas- 
ure sprang from the fact that intelligence tests had proved to be a ready 

1 K. Pintner, Intelligence Testing^ p. v (New York, I93.S). 
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and on the whole successful instrument for the speedy grading of the large 
body of men needed when the United States entered the World Ward It 
was soon discovered, however, that too much was being claimed for intelli- 
gence tests. They were severely criticized as being too deterministic and fatal- 
istic in their assumptions and capable of being employed as instruments with 
which to attack the American ideal of equality of educational opportunity, 
if the results were used to determine arbitrarily the scope and limits of an 
individual’s educability.^ These criticisms, which were launched by Professor 
William C. Bagley against the misuse of the intelligence quotient, threatened 
in part by those who seemed to exaggerate the significance of intelligence 
testing and m part by inferences drawn from the results of the army tests, 
had the very salutary effect of directing attention to a definition of what was 
meant by intelligence which the tests professed to measure. In a report on 
“Principles underlying the Construction and Use of Intelligence Tests” Pro- 
fessor Stephen S. Colvin had ample grounds for writing 

Indeed, there is danger at present that the movement in the direction of 
intelligence testing may grow out of all bounds; that it may be misunder- 
stood in theory and erroneously and even harmfully applied in practice,'^ 

The determinists were too ready to accept the intelligence quotient as a fixed 
and unchanging datum. Current opinion on the question may be indicated 
by Professor Colvin’s discussion of general intelligence. 

By the word general is commonly understood an innate ability or group 
of abilities that lie at the basis of the acquired intelligence of an individual. 
Intelligence itself is not inborn, only the capacity to become intelligent. . . . 
While all competent authorities would agree that the expression “general 
intelligence” designates inborn capacity to acquire intelligence in the vari- 
ous situations of life, they would disagree as to the further interpretation 
of this term, in regard to the significance not only of “general” but also of 
“intelligence.” There are .some who hold that the word “general” signifies 
a single inborn capacity to become intelligent in all situations; others that 
the term “general” means nothing more than that a person is born with a 
large number of specific capacities, more or less related, which enable him 
to acquire intelligent behavior in many different activities. The supporters 
of this first view, notably Spearman, Hart, and Burt, explain innate intelli- 
gence as a “general common factor.” . . . [Thorndike] holds to a multiplic- 

1 C. S. Yoakum and R. M. Yerkes, Aimy Menial Tests (New Yofk, 1920). 

W. C. Bagley, DetermMism in Educaiioyi (Baltimore, 1928); Education and Btmeraent Man, Ch. VII 
(New York, 1934). 

3 National Society for the Study of Education, Twenty-first Yearbooh, p. 11 (Bloomington, III, 1922). 
Quoted by permission of the Society. 
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ity of innate abilities that are related in varying degrees. He believes that 
between desirable single traits in a single individual there is a positive re- 
lation. . . . After all, to the practical schoolman it makes very little differ- 
ence whether general intelligence is a central factor or a bundle of differ- 
ent abilities related positively; the child cannot he treated as a unit — he must 
be discovered in his various tendencies and abilities and if we wish to laiow 
him as he really is, we must be able to work out the “psychogram” which 
Professor Whipple has mentioned. . . . [Intelligence tests] determine an 
individual’s intelligence largely in terms of what he has learned, thins ob- 
taining a measure of his ability to continue learning. ... We shall not be 
far from the truth when we define general intelligence as a grouf of innate 
capacities by virtue of which the individual is capable of learning in a greater 
or less degree in terms of the amount of these innate capacities with wh ich he 
is endowed. . . . Intelligence must be acquired. Only the capacity is inborn.^ 

Since subsequent developments in measurement have been based on this 
clarification of the intelligence test, Professor Colvin’s statement may be 
supplemented by another definition by Professor Ben D. Wood of Columbia 
University: 

The intelligence test is a highly specialized instrument, designed mainly 
to measure the one factor of mental alertness. It does not, unfortunately, 
measure the intellect directly, but something else which under certain con- 
ditions is almost if not quite synonymous with intelligence. This “some- 
thing else” that is measured in lieu of intelligence is very complex, and in- 
cludes such elements as achievement in English language, information in 
special fields, ability to think in terms of facts and relations in specific 
fields of iuformation, expressed in a certain language. The analysis might 
be carried to much greater detail. But obviously, the intelligence test is a 
direct measure of certain types of achievement and habit, and measures 
intellect only when each individual measured has had an equal oppor- 
tunity in those specific types of achievement, except insofar as inequalities 
in opportunity are due to inequalities in native intellect.- 

In other words, the intelligence test itself in any case measures scholastic 
attainments; it may reveal capacity but not the specific nature of such capac- 
ity. Further investigation which resulted from the recognition of this fact 
also indicated that the results are not stable and unvarying. Finally, it was 
realized that the test itself does not measure the total multiplicity of innate 
abilities and characteristics that make up intellectual capacity and person- 
ality. From the point of view of prognosis or prediction of scholastic success 

1 Ibtd., pp. 11-17. Quoted by permission of the Society. 

^ Ben D. Wood, Measurement in Higher Education, pp. 53 f. (Nev York, 1933). 
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it was admitted that intelligence alone, however carefully Tiicasured, is only 
one of a number of determining factors. Intelligence tests have thus been 
found to measure what they measure and, while useful as a general guide, 
cannot be employed as measures cither of specific types of ability or of the 
total complex of abilities, habits, and perseverance which are determined by 
environment, experience, education, and opportunity and which in turn deter- 
mine the nature and extent of the educational achievement of each individual. 

Nor were standardized tests of achievement exempted from ci’iticism. It 
was recognized from the start that certain subjects, such as arithmetic, hand- 
writing, spelling, and reading, lend themselves more readily to measurement 
by standardized tests than do others, such as history, geography, and litera- 
ture. Particularly is it difficult to devise norms for an educational system as 
varied and diversified in pupils, environment, and teaching personnel as the 
United States. While from one point of view the introduction of standardized 
tests w'as welcome and salutary because of the existence of so many widely 
differing standards, it was felt that such tests helped to esLabli.sli norms for 
groups rather than standards for the individual pupil. For in the words of 
Saudiford ; 

A standard differs from a norm. It represents the score which a pupil is 
expected to make, while a norm is the median score that a sample group 
makes on a test. The standard to be set must take in the whole programme 
of the pupil — at home as well as at school. Usually, however, the norm 
is considered as the standard to be achieved,^ 

Another serious criticism which tended to throw suspicion on the whole move- 
ment was the fact that tests were too frequently prepared by experts in 
measurement without the cooperation of subject matter specialists. Equally 
open to criticism is the tendency on the part of subject matter specialists to 
prepare their own tests without a thorough realization of the technical prob- 
lems involved in such preparation. Such criticisms do not, however, affect 
the general principles upon which standardized tests are based and are valu- 
able in directing attention to the dangers which may result from their misuse. 

The arguments in favor of measurement in education have been most 
clearly and succinctly stated by Professor Edward L. Thorndike: 

The task of education is to make changes in human beings. We teachers 
and learners will spend our lime this year to make ourselves and others dif- 
ferent, thinking and feeling and acting in new and better ways. These class- 
rooms, laboratories and libraries are tools to help us change human nature 
for the better in respect to knowledge and taste and power. For mastery 

1 P. Sandiford, Educational Psychology, p. 310 (New York, 1928). 
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in this task, we need definite and exact loiowledge of what changes are 
made and what ought to be made. In proportion as it becomes definite and 
exact, this Icnowledge of educational products and educational purposes 
must become quantitative, taking the form of measurements Education 
is one form of human engineering and will profit by measurements of human 
nature and achievement as mechanical and electrical engineering have 
profited by using the foot-pound, caloric, volt, and ampere. . . . 

It may be expected that measurements of achievements and capacity 
and their quotients will soon be developed for use in high schools, colleges, 
and professional schools. It surely is unwise to have the measure of col- 
lege students’ achievement in English composition, or tiigonometry, or be- 
ginning chemistry, or economics, or second-year French depend upon the 
caprices of a thousand dilFerent individual instructors, if by enough inge- 
nuity and care we can devise tests that will measure their acliievemenLs 
uniformly and precisely. The present condition at its best is shocldng. The 
average correlation between grades given in a subject and a student’s real 
achievement in it is, in even the best American colleges, almost certainly 
not over .80, which means that the oflScial ratings are six-tenths as erro- 
neous as would be the case if the grades were assigned at random by a child, 
as in a lottery’ If 900 students pass and 100 fail by the official ratings in a 
subject, there is every reason to believe that nearly half of those wffio failed 
really did better than some of those who passed. . . . 

It surely is unwise to give instruction to students in disregard of their 
capacities to profit by it, if by enough ingenuity and experimentation we 
can secure tests which measure their capacities beforehand. . . . 

On the whole, it appears that the effort to replace opinion by measure- 
ment in our ratings of the achievement of higher education will increase 
and spread rapidly. Indeed, it may soon need protection from over-ex- 
travagant hopes more than from hostile criticism.^ 

The New Type Tests 

Out of the criticisms of the traditional examinations on the ground that 
the marking is subjective aud consequently neither valid nor reliable, of 
standardized tests for the reason that they set up norms which are not uni- 
versally applicable, and of intelligence tests because they are neither specific 
nor comprehensive in what they measure, there arose the new type test 
which, while made possible by the techniques already established for the de- 
velopment of standardized and intelligence tests, may be used to test infor- 
mally any subject of the curriculum at any level of instruction. 

1 E. L. Thoindike, “Measurement in Education.” National Society for the Study of Education, 
Twenty-first Yearboolc, pp. 1-8 (Bloomington, III , I92J). Quoted by permission of the Society 
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The theory upon which the measurement of educational products is based 
has been clearly defined by Professor Thorndike : 

Whatever exists at all exists in some amount. To know it thoroughly in- 
volves knowing its quantity as well as its quality. Education is concerned 
with changes in human beings; a change is a difference between two condi- 
tions; each of these conditions is known to us only by the products pro- 
duced by it — things made, words spoken, acts performed and the like. To 
measure any one of these products means to define its amount in some way 
so that competent persons will know how large it is, better than they would 
without measurement. To measure a product well means so to define its 
amount that competent persons will know how large it is, with some preci- 
sion, and that this knowledge may be competently recorded and used. . . . 

In general the nature of educational measurements is the same as that 
of all scientific measurements. In detail, however, there are notable dif- 
ferences. An educational product, such as a composition written, a solu- 
tion of a problem in arithmetic, an answer to a question, or the perform- 
ance of an errand, is commonly a complex of many sorts of things.’- 

The new or objective type of examination is a form of test which seeks to 
reduce the weaknesses and defects of the written or essay type of examina- 
tion and which aims to yield results which are objective and more valid, re- 
liable, accurate, and comparable in similar situations than the old. The chief 
characteristic of the new type test is that it calls for a short answer by one 
or a few words, by a check mark, or by a number, and can be answered only 
if the individual under examination has the pertinent laiowledge immediately 
and readily available. A very marked and important difference is that, while 
in the essay type of examinations the number of questions to be answered is 
limited particularly by the amount of time required for writing the answer, 
the new type test provides for a wider sampling of the content of the sub- 
ject of the examination and is more comprehensive both in scope and extent 
and in range of difliculty. In place of the small number of questions which 
may be asked in the essay or long answer test, as many as from 50 to 100 or 
more items may be answered in an hour’s new type or short answer examina- 
tion. From this point of view alone the new type test reduces the element of 
chance or luck so far as the examinee is concerned because of the compre- 
hensive range of the questions selected; to this extent it is fairer to the stu- 
dents. 

A further advantage claimed for the new type test is that since the answers 

1 E. L. Thorndike, “The Natme, Purposes,, and Geneial Methods of Educational Products.” National 
Society for the Study of Education, Seventeenth Yeaihool, pp 16 and 17 (Bloomington, 111., 1918). 
Quoted by pei mission of the Society. 
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must be short and specific the irrelevant factors, which according to investi- 
gations may distract attention from the real marldng of the essentials, are 
removed or reduced to a minimum. This means in turn that the personal 
equation or subjective opinion does not affect the judgment of the examiner. 
The marking or scoring is thus objective on a scale which consists of a series 
of small units easily agreed upon by competent examiners. The results are 
more accurate because only one variable, whether the answer is correct or 
incorrect, is measured at a time. 

It is important to note a still further distinction between the traditional 
and new types of examination. The preparation of cpiestions which call for a 
long answer does not on the whole take a great deal of time, while the cor- 
rection of the papers is an involved and laborious process. The nevr type test, 
on the other hand, is more easily administered and marked, but its construc- 
tion requires far more time and care, a fact which is frequently ignored. To a 
far greater degree than the essay type the new type test arises more directly 
out of the materials of instruction and represents the results of an extensive 
survey of the subject examined on the basis of courses of study, textbooks 
used, and the opinions of experts. The construction of the new type test 
brings together in a cobperative effort the teachers of a subject and the ex- 
perts in measurement. The new type test may, however, have the same 
character of detachment as any other form of external examination. For this 
reason it is subjected to the criticisms that it controls the organization of the 
content of courses of study, that it leads to special preparation, that it in- 
terferes with the flexibility and adaptation of courses of study.^ 

It is doubtful whether these criticisms are warranted; they are a repetition 
of the traditional criticisms of examinations and come in the main from that 
school of educational thought which claims, on the one hand, that any form 
of test tends to warp the main functions of education — the promotion of 
growth, the development of personality, and training in “how to think rather 
than what to think” — and, on the other, that the same results can be at- 
tained by the progressive methods as are achieved by the traditional. The 
practice of measurement is based on nothing more than the premise that if 
a subject is studied the school is justified in assuming that there has been 
some achievement and that that achievement should be measured in the in- 
terests of the orderly educational and instructional progress of the pupils. 
From this angle any form of test which attaches importance to the organiza- 
tion of curriculum according to subjects, which lays stress on content values, 

1 See Selections 880-886 in W H. Kilpatrick, Somee Book in Philosophy of Education, pp. 455 ff. 
(New Yoik, 1934). 
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and on systematized knowledge, facts, and information is open to objection 
from those who wish to organize the work of the school on what it termed an 
activity programd 

More fundamental and relevant is the ci’iticism, particularly from those 
who rightly value the merits of the essay examination and fear its disappear- 
ance, that the new type test, consisting of 100 or more items to be answered 
in a short time, is a test only of memory of facts, information, or knowledge, 
and that it cannot serve as a test of reasoning or the logical processes of 
thought as may be indicated in the organization both of laiowledge and ideas 
called for in an essay examination. This criticism has not been ignored; consid- 
eration and discussion of it have gone far enough to prove that it is not valid 
unless it is assumed that the recalling of facts and information and thinking 
are independent functions of intelligence, and that reasoning is largely de- 
pendent upon the external form as opposed to the substance of a question. 
The first c|ucstion suggested by this criticism is. What is the place of facts, in- 
formation, and Icnowledge, and what is their importance in the equipment of 
the educated man as well as the professional workerp The question has been 
well answered by President A. Lawrence Lowell: 

Throughout our lives we are constantly forced to muster all we can of 
our previous Icnowledge, and the habit of doing so can be cultivated by 
practice. How often when the occasion has passed do we ask ourselves, as 
a student does after an examination, why we did not remember some 
essential fact. The art of recalling quickly, fully, and accurately is cer- 
tainly a valuable part of mental training. It is a special art, not the same 
thing as a rich store of Icnowledge. Some men have all the knowledge they 
possess ready for use on demand; some require a certain time for reflec- 
tion before they can produce it; and some can make use of it only in the 
solitude of their studies.^ 

Actually it is impossible to make a clear distinction between thinking and 
memory of facts by means of a test.* To the criticism that the new type tests 
are only tests of memory, the answer given by Professor Ben D Wood in 

^ On Ihe question whethei progressive schools should abstain from the use of tests see R. W. Tyler, 
“Evaluation! A Challenge and an Oppoitunity to Progressive Education." Educational Record, Jan- 
uaiy, 1935, pp. 121 ff. “Experience shows that many of the areas which are now called intangible and 
incapable of evaluation can be appraised and that this appiaisal can become more and more accuiate 
and valuable ” {Ibid., p. 138.) 

^ A, Lawrence Lowell, “The Ait of Examination.” Atlantic Monthly, Vol. CXXXVII, January, 1926, 
p. 62. 

8 See the study previously mentioned by R. B Weaver and A. E Traxler, "Essay Examinations and 
Objective Tests m United Stales History in the Jnnioi High School." tichool Review, Vol. 39, 1931, 
pp. 689 ff 
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1923, when the new type test was in its infancy, has been confirmed both by 
subsequent experience and by experimental studies. 

There is not as much opposition between “information” and “reason- 
ing” as some teachers would have us believe. Facts do not exist in the 
mind in isolation. We remember by thinking and we think by remember- 
ing facts. Those who declaim against tests of “mere facts acquired and 
remembered,” should realize that we cannot think without facts. We could 
not neglect the measurement of facts without neglecting the niea.surc- 
ment of the very fabric of thinking. When we consider that facts are not 
only a legitimate and undoubted aspect of thinking, and also that they 
can be acquired, retained, and reproduced only by thinking, only by organ- 
izing material in a logical and systematic manner, there can be no doubt 
of the value of a pure information test. In fact, the measurement of reason- 
ing and organizing ability in a field of knowledge would be very defective 
and incomplete without a measurement of the breadth of information in 
that field. Breadth of information cannot be tested with the essay form of 
examination in a three hour peiiod, for the simple reason that on physical 
grounds only so many pages of prose may be produced m three hours; and 
even if this defect were absent, range of information could not be objec- 
tively and reliably measured with the essay form of examination. 

Fortunately, we do not have to depend on theoretical considerations, 
Every experimental study thus far made and reported has shown a very 
high relationship between measurements of information in a field and in- 
telligence or ability to think in the material of that field.^ 

Those who are inclined to criticize the new type test on the ground that it 
only tests memory and not the “higher processes” of thinking either mini- 
mize the importance of a knowledge of facts and information as the nec- 
essary material for thinking or rely on a psychology which cannot be de- 
fended. One may have the capacity to think but that capacity is idle with- 
out a thorough and comprehensive mastery and retention of knowledge and 
ideas which can only grow out of knowledge. The case for the new type test 
has been excellently presented by Dr. William S. Learned: 

How will it profit us even in case we do secure a trustworthy index of a 
student’s knowledge? In short, just how indispensable is laiowledge in 
education? 

There appears to be no way of evading the primary truth that thinking, 
which is assumed to be the fundamental process in education, if done at all, 
must be done by ideas or concepts which the mind presents on demand of 


^ Ben D. Wood, Measm einent in Higher Educaiiony pp, 16i f. (New York, 1953). See also Ben D. Wood 
and F. S. Beers, “Knowledge versus Thinking^” Teachera Coll&ge Tiecord^ 1936, pp. 487 fF. 
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any given need or situation. Furthermore, the success or satisfaction result- 
ing from thought will clearly be in such proportion as the concepts thus 
provided are adequate both in number and in clearness of definition. A “re- 
sourceful” mind is one which, at each step of its procedure, is supplied 
automatically with such a variety of clear-cut, relevant suggestions that 
its problem becomes one of selection. Several possibilities are normally 
present — and present in such form that a choice can be made intelligently 
because each possibility assumes to the main situation relations that are 
sharply defined. The ineffective mind, on the contrary, offers little or 
nothing to meet a need; its proposals are either hearsay recipes that have 
no real application or else are so vague and cloudy as to be worthless. 

The test of education is therefore plain. Its business is, first, to increase 
the material which the mind thus has ready for use. To this end it seeks to 
expose the student to important facts, ideas, and values as widely as these 
can be effectively appreciated and absorbed. Second, and far more im- 
portant, it must ensure the availability of this store of material by pro- 
gressively refining and clarifying its meanings. Through frequent resLudy 
and redefinition of the ideas themselves, by approaching them deliberately 
and repeatedly from fresh points of view, an understanding of their bear- 
ings and interrelationships gradually matures and becomes an increasingly 
vivid possession of the student.^ 

The criticism is based, furthermore, on an assumed requirement that all 
the steps in a process of reasoning should be presented, as is expected in an 
essay, as well as the end-product, without realizing that this end-product 
must have been reached by a process of reasoning even though the steps are 
not written out in full. 

As for the argument that the essay examination measures thinking, while 
the objective test measures mere memory, more heat than light is gen- 
erated by its advocates. The proponents assume, usually unconsciously, 
that a student must present the steps in his reasoning before they will 
accept the end-product as more than mere association. It is no weakness in 
the objective test that it demands of the student that he shall do his 
thinking subvocally and without movement of the wrist in writing before 
indicating the end-product of his thinking.^ 

It cannot be repeated too often, however, that those who have been the 
leaders in advocating the use of the new type test have not suggested that it 
should displace the essay as a form of training and practice in the clear organ- 

1 W. S. Learned, “Testing for Values in Education,” pp. 2 f., in Reprint fiom the Bulletin of the Asso- 
ciation of American Colleges, Vol. XX, No. 1, March, 193-1. 

2 M. S MacLeaii, “The Problem m the General College,” in Studies in College Examinations, p. 14, 
(University of Minnesota, Minneapolis, 1934). 
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ization and logical presentation of facts, concepts, and ideas. The only claim 
that they make is that the new type test is a better instrument not only for 
measuring the amount of information acquired and reasoning ability, but 
also for other purposes which are important for educational controls. The 
possibility of formulating essay questions in such a way that the answers 
can be marked objectively and yield more reliable results than marking by 
general impression is not excluded, but the more accurately and carefully 
this is done, the closer will be the approximation to the new type test and the 
less in the long run will be the real educational value of the essay. In a recent 
study of the two methods of examination the results were summarized as 
follows : 

Research with the essay test has, in the main, been conducted with the 
traditional or unimproved form and comparisons have been made with 
improved forms of objective tests. Such comparisons indicate that the 
improved objective test measure.s as accurately as or better than the un- 
improved essay test. When analysis of essay tests into defined types such 
as list, outhne, describe, compare, contrast, explain, discuss, develop, evaluate, 
and summarize is achieved for instructional use, comparative studies using 
improved essay types and improved objective types of tests will become 
possible. 

The use of both objective and essay tests seems to be a better basis to 
evaluate the achievement of such varied results as specific, general, and 
organized information.^ 

The new type test is considered superior to the old for a variety of reasons, 
among them the following: 

(1) It more nearly meets the standards of definable validity, that is, it 
measures to a known degree what it is designed to measure to the exclusion 
of factors irrelevant to this particular end. 

(2) It is statistically more reliable in the sense that the scores on two equiv- 
alent new type tests given to the same pupils agree more closely than do the 
scores on two supposedly equivalent essay type tests of equal length. 

(3) It is more objective since subjective factors such as bias, prejudice, 
pei'sonal opinions, and temperament are reduced to a minimum and the scores 
are so accurate and consistent that they would always be the same no matter 
what the number of examiners might be. 

(4) It is accurate in the sense that the units of measurement are more 
nearly equal at all points of the scale. 

^ C. C.'Weidemann, “Uecent Developments in the Written Essay Examination.” Rernma ofEdaoahonnl 
Research, Vol V, December, 193o, p. 489. A Lst of investigations on the subject is given on pp. 616 f. 
of this issue. 
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(5) It is more compreiensive because it includes a wider sampling of the 
subject of the examination and to that extent is also more reliable. 

(6) It is easily administered and marked with economy of time and eflort 
for both examiners and pupils, but it requires more time to prepare than the 
traditional examination so that the standards of scientific measurement may 
be adequately met 

(7) The results can be interpreted more easily and used for specific pur- 
poses of improving weaknesses discovered in pupils or encouraging ability. 

Hence the new type test by new methods and techniques seeks to meet 
those difficulties which are encountered in the attempts made to secure accu- 
racy and reliability in the marking of the traditional examinations by consul- 
tation, conference, supervision, and recbecking but, as experiments have 
proved, without great success. Unlike the essay type in external examinations 
the items in a new type lest are based on matter actually covered or assumed I o 
have been covered by a given group in a given course and are based on courses 
of study, textbooks, and the opinions of subject matter experts. They can 
thus probe into every phase of a subject in order to secure a wide samjiling of 
knowledge and to this extent eliminate from instruction the al tempts to 
guess at or to emphasize or gamble on “examinable” topics. 

The new type test should accordingly not interfere with the process of in- 
struction as is so often the case when external examinations are the object of 
preparation. The construction of the new type test involves far more Lime 
and care than the preparation of the traditional examination. As a rule more 
questions are prepared than will be used in one test in order to afford a l^asis 
for the selection of the best. Questions which are ambiguous as to meaning 
and possible answers are excluded. The items are short and so selected that 
even the poorest student can answer some correctly and the best the major- 
ity but not necessarily all; a series of items may accordingly be arranged in 
equal numbers of easy, moderately difficult, and difficult character. The stu- 
dents are given specific directions usually accompanied by an example. The 
test is as a rule “timed.” The answers are written in alongside of the questions 
and can be easily scored with a key, so that expertness in preparing the test 
is substituted for expertness in correcting the answers. 

A further advantage claimed for the new type test is that it lends itself to 
organization in a variety of forms, while the essay type of question is, as a 
rule, restricted to a few limited forms, such as “describe,” “discuss,” “com- 
pare,” “give reasons for,” “explain,” and “tell what you know about.” The 
most usual forms of new type test which have been developed and used are 
the following: 
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(1) Recall type which requires the insertion of a word to make a statement 
true. 

(2) Somewhat similar to the recall type is the completion test in which 
missing words are to be supplied in a series of statements. 

(3) Recognition type, in which a number of suggested answers to question.s 
are supplied and the student is required to select the best or the correct an- 
swer from among them. The recognition type of test may take one of three 
forms: (a) the True-False test in which the student has to judge the truth or 
falsity of a number of statements; the answer may be given by underlining 
the words True or False, or the letter T or F, or by Yes or No, or by a pins 
or zero sign. From such evidence as is available the objection to this test that 
a student may learn a false statement is not warranted. On the other hand, 
it IS obvious that the true-false test does not lend itself equally well for use 
in all subjects. That the element of guessing may enter is generally admitted; 
its influence is, however, reduced by the use of the formula Rights minus 
Wrongs in determining the score, (b) The Multiple- Choice Test or Multiple- 
Response Test which involves the choice of a word or phrase which makes 
the best answer in a statement. The answer may be given by underlining the 
appropriate word, or by inserting a number, if the suggested answers are 
numbered, or by putting a check against the best answer, (c) The Matching 
or Association Test involves the matching or pairing of two sets of associated 
facts each of which are arranged in parallel columns in chance order. 

(4) Other forms of tests are in general variations of these more common 
forms, such as the Analogies Test, Similarities Test, a Classification oi' Cross- 
cut Test. Each of these tests may be used independently or in combinations 
to form a “battery of tests.” The simplicity of the finished product is likely 
to be delusive since more is involved in the preparation of test items than in- 
verting or disguising questions. The amateur is likely to plunge into the 
preparation of tests without realizing the editorial and statistical difficulties 
involved in constructing and scaling them, in interpreting scores, or in con- 
verting scores into grades.^ 

Purposes of Examinations 

The purpose of the traditional examinations was in the main to discrimi- 
nate between students who should pass or fail on the basis of some precon- 

1 The follow mg brief list of references will serve as an intiodiiction to the subject- 

A R. Lano, Jlndeni Methodt in Wi iftenMiaminatinns (Boston, 19,101. 

W. A. McCali,, How to Mensuie in Ediirntion. (New York, 1922) 

W. S. MoNiiop,ir7-inen Examinations andtlmr Improvement Umveisityof Illinois RuRetm, Volume 
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ceived standard of achievement. In general the results of such examinations 
have been as immutable as the laws of the Medes and Persians. To a certain 
extent they helped to standardize the instruction of the schools or educational 
institutions which were subjected to them; to that extent also they have often 
been used as much as a test of teachers as of their pupils, and the quality of a 
school has been judged by the number of its successful pupils. Underlying 
this practice have been the assumptions that the standards of assessment 
were always unchanging, that the opinions and judgments of examiners were 
invariably infallible, and that the curriculum and courses of study were 
always adjusted to the needs and abilities of all pupils or students at a given 
level; hence the pupil or student who failed stood condemned as incapable 
and was separated by a wide gap from the one who just managed to pass. 
Examinations of such a type have rarely been used either as a means of dis- 
covering where a pupil’s weaknesses he or as a basis for remedying these de- 
fects; still less have they been employed for diagnostic purposes, that is, to 
discover the type of course from which a pupil is most capable of proliting. 
The traditional examination, particularly if conducted by an external boarfl, 
allowing for the somewhat greater choice of subjects which has been i)ermit- 
ted, is still built on the assumption of identity of abilities rather than on a 
wide range of variability. Hence the difference of a few marks may deter- 
mine whether a student is to be admitted, in a European country, for ex- 
ample, to a secondary school, or to a higher institution. Too frequently a 
career depends upon the hazard of one examination, marked by examiners who 
in order to maintain standards of faii-ness, detachment, and impartiality pre- 
fer to loiow nothing more about the candidate than is revealed in his papers. 

Such a conception of examinations may have been justified at a time when 
opportunities for secondary and higher education were selective on some 
basis or other, although there is ample evidence of dissatisfaction with and 
criticism of the traditional examinations for more than half a century and 
not always for technical reasons alone. The situation, however, is changing 
everywhere. The task which confronts educators to-day is not one of separat- 
ing the sheep from the goals, of dividing the population into those who have 
passed and those who have failed, or of settmg up the curriculum as a hurdle 

20, No. 7, Bureau oj Educational Research Bulletin, No. 9 (Urbana, 1933). 

C. W. ODEir., Traditional Examinations and New-Type Tests (New Turk, 1928). 

D. G. Patersos, Preparation and Use of Neic-Type Examinations (Yonkers, N. Y 1925) 

G. M. Roch, The Impi overnmt of the Wi itten Emmination (Chieago, 193 1). 

, The Objective oi New Type Examination, (Chicago, 1929 ). 

C. PiussFEL, C'lassioom Tests (Boston, 1926). 

P. M SyjrovDs, Measurement in Secondar y Education Yoik, 1937 ). 

Ben D. Wood, Measurement in Ihghei Education (Yonkeis, N. Y.' 1933)! 
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to be overcome. With the inevitable prolongation of “infancy,” in the sense 
used by John Fiske, due in part to economic reasons and in part to the ex- 
tension of the compulsory age for school attendance, the problem has ceased 
to he one of selection and has become one of the distribution of education, or 
the discovery of “the right education for the right pupil under the right 
teacher.” The success of an educational system can or should no longer be 
measured in terms of the numbers who pass or fail in examinations but by 
the degree to which it has been able to discover the abilities and needs of 
pupils and students and has provided for them the type of education from 
which they are capable of profiting. And for this purpose the traditional type 
of examination cannot be used, for the problem is not merely one of selecting 
an elite or even elites, since the types of leaders required by modern societies 
have increased in numbers, but of giving to all the type of education and in- 
struction that will equip them, in accordance with their abilities, to be useful 
members of society. 

The question here involved may be asked in another way — How much 
education has an individual received if he leaves school with a record of fail- 
ure or with a record of just having passed, and so on? Those who fear to ap- 
proach the question in these ways are alarmed, first, lest standards will in- 
evitably be lowered, if more pupils or students pass or, second, lest the intro- 
duction of modifications in the established concepts of educational curricula 
lead to a dilution of the best education for the best minds. The recent educa- 
tional history of Prance and Germany furnishes ample evidence of the fact 
that the large increase in the numbers attempting to meet the existing re- 
quirements of secondary education has provided sufficient justification for 
the first fear. On the other hand, if society through its educators undertakes 
to discover types of education best suited to the great variability of intellec- 
tual capacity the second danger need not be imminent. It was a recognition 
of the possibilities of this solution that prompted those who have been lead- 
ing in the movement for the creation of the Scale unique to recommend the 
creation of a National Bureau of Selection and Guidance. No steps had, how- 
ever, been taken to devise either methods or eurricula to implement this 
suggestion.^ 

If the traditional examination method has ever been used for any of these 
purposes, it has on the whole been used in a negative way, to weed out those 
who were not likely to succeed in a particular type of course or career rather 


1 That the French baccalaiii kit created for one purpose may no longei be adapted to meet the demands 
of changed social and economic conditions is suggested in a discussion of this e\dinination ui the French 
Committee’s La Correction des Epreuves Ecides dans les Exaimns, pp. 38 ff. (Paris, 193(i) 
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than to discover the nature of abilities and to make the necessary adjust- 
ments to them. The new type test serves most of the purposes which the 
traditional examination may in the minds of some have been supposed to 
aim at but which it fulfilled only empirically and in a snapshot rather than a 
detailed manner. The new type test furnishes more reliable information as 
to a pupil’s achievement and, because of the range of the samplings, provides 
a better clue to his weaknesses; in the case of the able pupil evidence may be 
secured as to whether he is worldng up to his capacity. It is thus an excellent 
basis for educational guidance, and, indeed, this function is beginning to be 
regarded as more important than the examination itself. 

The first question that the school should ask and answer at least pro- 
visionally several times each year, write.s Professor Wood, is “What can 
Johnny learn, and which of the things he can learn should the school, in 
the light of all the facts, tiy to help him to learnP . . . Tests should first of 
all tell us what the pupil should try to learn — not hoiv he may be caijoled, 
persuaded, or insidiously coerced into learning item x in the standard <>ur- 
riculum for grade n. If a pupil has difficulty in learning item x, this fact in 
itself may be evidence that z is not suited to his capacity and needs and 
that he should, therefore, be given opportunity to learn something else, 
not forced by remedial treatment to live up to the “high and ever higher 
standards” so often found in perorations that are more impressive than 
meaningful. . . . Pupils who after a year or two of trial cannot learn might 
be excused even from some of the supposed essentials of the elementary 
curriculum and encouraged to study some vocational subject or subjects 
that lie within their capacities and interests and thus have meaning for 
them. In many cases this procedure would not lessen their achievements in 
the elementary curriculum, and might engender better habits and more re- 
sponsible attitudes in place of the disappointments that now frequently 
result.^ 

This idea Professor Wood repeats in another form as follows: 

The duty of educational institutions of non-professional character is to 
help boys and girls to become better citizens, with the aid of the curricu- 
lum, if possible, but in spite of the curriculum, if necessary; and that the 
method of achieving this objective is to mobilize half our educational re- 
sources, if necessary, to the task of ascertaining the abilities and needs of 
pupils as gi’owing individuals, and to use our remaining resources to meet 
those needs, whatever those needs happen to be.^ 

1 Ben D. Wood, Basic Considerations m Educational Testing, pp. 9 If. (193S). 

^ Ben D. Wood, The Ultimate Basis for Satisfactory College-High School lielations.” Bulletin of the 
American Association of Collegiate Registrars, July, 1934, p 273, 
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Introduced and developed first in order to secure more valid, accurate, re- 
liable and objective results than were obtainable by the old type of examina- 
tion, the new type test has been welcomed as a valuable instrument for edu- 
cational guidance, as the following statement by Dr. C. R. Mann, formerly 
Director of the American Council on Education, indicates; 

Along with more skillful production of su^h measuring instruments has 
come increasing recognition of their value. Now the testers tell us that 
their tests are proving more u.seful as instruments for educational guidance 
than for ranking students in the order of their proficiency in particular 
school subjects. They reveal what sort of things each student does well as 
well as the things he docs badly. Emphasis can then be given in each stu- 
dent’s program on things he does well rather than on those he does badly. 
When this is done, he will be more profitably employed in school than if he 
is driven through a set curriculum of traditional subjects many of which 
he does not get at all.^ 

The value of the new type test would even be increased by frequent repeti- 
tion, provided accurate records were kept and suitably interpreted . 

We should rather multiply examinations and tests, of many kinds, using 
them frequently, hut always informally, casually, and skeptically; record the 
results, of course; correlate and study these results; study particularly the 
patterns of results in each student’s cumulative record, in conjunction with 
personal impressions, teachers’ grades, or, better, teachers’ estimates, and 
all available facts in regard to the student’s background and achievement; 
and base the necessary administrative decisions, with respect to gradua- 
tion, promotion, classification, and guidance on the total picture of the stu- 
dent’s abilities, aptitudes, character and potentialities — to which total 
picture a considerable number of comparable test results would seem to me 
to contribute a vitally necessary part.- 

This function of the new type test aptly fits in with recent tendencies in 
the concept of educational administration and organization, for, according 
to Dean H. E. Hawkes of Columbia University, 

in order to do our jobs either in schools or in our colleges, we need and must 
have more information than has ever been available concerning the char- 
acteristics, capacities and past achievements of our students, if we are to 
do them justice or hope to approach our own standards of accomplish- 
ment.® 

1 C. R.. Mann, “The N.R.A and the Schools.” Educational Ueeord^ October, 1933, p 4 j': 2 
3 Max McConn, “Measurement m Educational Expeiimentation.” Record^ January, 1931, 

p. 118. 

3 H. E. Hawkes, “Dangers in the Testing Movement ” Ediirntional Rerntd^ January, 193o, p. 
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Finally, the use of examinations is determined not only by a philosophy of 
education but also by a social philosophy, which has been well stated from 
the American point of view by the University Committee on Educational 
Research of the University of Minnesota; 

The expanding program of examination activities . . . has, thei’efore, 
not taken place without dclsp underlying causes in the social order. The 
motivation is primarily the search for quality in human beings. It arises 
from economic pressures, the surplus of workers, and the competition for 
effective service. In the schools, the search is for quality of mind, chiefly 
intellectual quality, that can be trained by the processes of education to 
higher competence. Although the evidence that examinations are assum- 
ing a new lole in American life is unmistakable, it is si ill unlikely that we 
shall surrender our national philosophy of equal educational opportunity 
for all the children of all the people. At every advancing step American 
society will uisist that examinations shall be of the sort that opens the 
doors of opportunity rather than closes them. They must reveal what 
young people can do and not merely what Ihey cannot do. They must not 
only be fair and accurate, but they must canvass the resources of the indi- 
vidual as well as his limitations. The American outlook will not long abide 
a merely negative program, but will insist on one which reveals possibili- 
ties even though it closes innumerable doors which seemingly have hitherto 
stood open.^ 

The new type test lends itself better than the traditional examination to 
improving the quality of instruction, because the points in which pupils are 
strong or weak are more clearly indicated in detail. It may be used for the 
promotion of pupils from class to class or school to school, and it may be 
employed further for comparing the results attained in different classes, dif- 
ferent schools, and different school systems. It is an instrument which, if 
wisely used, can serve a number of educational and instructional purposes, 
but as in the case of standardized tests and intelligence tests, it has not met 
the expectations of those who are still looldng for a single instrument which 
will measure all the purposes of education — intelligence, personality, atti- 
tudes, characler, vocational capacity, achievement, and promise of success 
in school, college, or after-careers.* 

The main uses of the new type test in elementary and high schools is to 

1 The Bulletin of the University of Minnesota, University Committee on Educational Research, Col- 
lege Examinations, Vol. XXXV, No 22, Apiil 11, 1932 (Minneapolis, Minn., 1932). 

^ See National Society foi the Study of Education, Twenty-first YearbooL; P, Symonds, Measure- 
ment in Secondary Education, pp. 1 ff. (New York, 1927); P. Mort, and A. I. Gates, The Acceptable 
Uses of Achievement Tests (New York, 1932); and Eevim of Educational Reseat ch, Vol V, No. 5, 
December, 1935, pp. 445 ff. and pp. 500 ff. 
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discover tLe ability and achievement of pupils and to advise and guide them 
appropriately. Since the high school is open to all who complete the six or 
eight grades of the elementary school without an entrance examination the 
function of the test becomes increasingly one of securing an adequate basis 
for guiding the pupils in the vast maze of choices open to them in the modern 
secondary school curriculum. The lest accordingly serves a dual purpose: 
measuring achievement and at the same time providing one basis for predict- 
ing success ; or the two purposes may be described as diagnostic and prognos- 
tic. In general, the school is as much concerned with the discovery of causes 
of failure as it is with the prospects of success. This means in turn the pro- 
vision of such varied curricula and courses of study as will make possible 
adaptations to pupil capacity and interests. A recent analysis of the “Present 
Tendencies in the Uses of Educational Measurements” closes with the fol- 
lowing summary: 

By way of conclusion, it may be said that the summary of the previous 
pages bearing upon the present tendencies in the uses of educational meas- 
urements indicates clearly that tests and measurements for their own sake 
are rapidly passing from the educational picture. On the other hand the use 
of tests as an integral and essential part of educational procedure and re- 
search is growing. Using tests for what they may contribute to the reali- 
zation of the important aims of education and the solution of educational 
problems appears decidedly to be the modern tendency ^ 

Increasing Enrollments and the Use op Tests 

Interest in the development of adequate instruments for testing and meas- 
uring the abilities of students in such a way as to secure valid, reliable, and 
comparable results was increased by two important factors : First, the rapid 
increase in enrollments in the high schools and colleges of the country after 
the World War and more particularly in the depression period following 
1929; and, second, an attempt to implement and redefine the traditional ideal 
of equality of educational opportunity by discovering the right education for 
the right student. Both factors combined to lead to the acceptance of the 
principle that the emphasis in educational administration and organization 
should be placed not upon the selection of the few on the basis of one crucial 
examination — a snapshot view, as it has been called — of the abilities of a 

"^Review of EduGational Rpscaich^ Vol. V, Decemberj 1935, p. 468 See also G. Hildreth, “Tests of 
Mental Capacity — High School Level” in A Bibliogia-phy of Mental Tests and Rating Scales^ pp 36 ff., 
and “Achievement and Educational Tests,” pp. 75 ff., R. Strang, Personal Development and 
Guidance in College and Secondary Schoolf Chs III and XV (New York, 1934); and P. Symonds, 
Measurement in Secandary Education^ Chs. XVII, XIX, and XXI (New Yoik, 1937). 
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student but upon the distribution of the right education based upon a thor- 
ough understanding of the whole individual derived from a study of his abil- 
ities, capacities, interests, and needs continued over a period of years. From 
one point of view this movement has meant a search for an instrument or a 
series of instruments which would enable educational authorities to guide 
students in the educational careers most appropriate to their abilities; from 
another it has intensified the criticisms which have accumulated during the 
last quarter of a century against the traditional notion that all students must 
be poured into the same mould of what have been defined as the essentials of 
a liberal education. 

As already pointed out the problem under consideration is an internal one 
so far as elementary and high schools are concerned because of the absence 
of any obstacles to advancement from one to the other. The prolrlom becomes 
particularly crucial at the stage when the admission of students from high 
school to college arises, for hei-e there are definite entrance requirements in 
some or most institutions and even under a system of accrediting graduation 
from high school furnishes no adequate guarantee of a student’s ability to 
succeed in academic work. While intelligence and standai'dized tests of .some 
kind have been used extensively in elementary and high schools, I heir use 
has on the whole been spasmodic and not cumulative in character in the 
sense of presenting a complete picture of the intellectual abilities and per- 
sonal and educational records of the pupils. 

During and immediately following the War the Ai’my and other intelli- 
gence tests began to be used extensively by colleges for purposes of admission. 
It was soon demonstrated, however, that the relationship between psycho- 
logical tests and academic success was not very high; in the majority of cases 
the coefficients of correlation were below .50. The Army Tests were found on 
the whole too simple for prospective college students, while the other tests 
attempted by a single measure to evaluate a complex of abilities. Further, 
since marks or grades in college were awarded on the basis of the traditional 
examinations and the subjective opinions of the instructors, they were them- 
selves unreliable and therefore unsatisfactory as a criterion of the predictive 
value of the psychological tests. Despite the low relationship between tests 
and academic grades the intelligence ratings derived from the tests proved 
to be valuable to deans and adimnistrative officers in dealing with students 
and also revealed the presence in colleges of students who under no circum- 
stances could be expected to succeed in the courses actually offered. 
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Experiments avith New Type Tests Columbia College 

111 1919 Columbia University undertook the experiment of admitting stu- 
dents to the undergraduate College on the results, among other requirements, 
of the Thorndike College Entrance Intelligence Examination . This Examina- 
tion was both more comprehensive and more difficult than the Army Alpha 
Test. The advantage of the Thorndike Examination over other tests ivas that 
besides being a test of intelligence it also included educational tests of a type 
and standard suitable for high school students. Candidates for admission to 
Columbia College were in all cases required to submit school and character 
records and might substitute the Thorndike Examination for the usual en- 
trance examinations. The Thorndike Examination has been proved to have 
a higher predictive value, at least for the first year of college work, than any 
other measure so far developed. While tests up to the time of the introduc- 
tion of the Thorndike Examination had in general shown a coefficient of cor- 
relation below .50, the correlation between the Thorndike Examination and 
the freshman year was early shown to be .63, between the Examination and 
the sophomore year .62, and between Ihe Examination and both years .67. 
It was further demonstrated that the Thorndike Examination had a predic- 
tive value of college success higher than the New York State Regents’ Ex- 
aminations, which was .64, and secondary school marks, which was only .26. 
The result of this experiment not only at Columbia College but also in other 
institutions was to shake confidence m the use of the Army Alpha Test which 
had already begun to be used by a large number of institutions and to be 
regarded as defective on other grounds.^ 

Further experimentation with intelligence tests for admission to college 
(and it must be noted that the character of the tests themselves had already 
changed from their original form and sought to test both native ability and 
educational attainments) has revealed the fact that, while they have some 
predictive value, they indicate probabilities rather than certainties. 

All of the studies agree upon the fact that there is usually a substantia] 
amount of correlation between intelligciiee test scores and scholarship 
among any student group. The fact that the correlation is not perfect in- 
dicates clearly that factors other than tested intelligence play considerable 
part in the determination of scholarship levels; but the size of the coeffi- 


1 See National Society foi the Study of Education, InteUigemv Tests and their Use, Ch X (Bioominp;- 
tnn. 111., 1923), Ben D. Wood, Measurement in Higher Educalinn, Chs. II-V (New York, 193Ei); 
National Society of College Teachers of Education, Yearbook XVIII, Quantitative Measurement in 
Institutions of Higher Learning, Ch III (Chicago, 1930); and R,. Strang, Personal Development and 
Guidance in College and Secondai g School, Clis. Ill and IV (New York, 1931). 
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dents of correlation that have been presented leave no doubt that intelli- 
gence is one of the basic factors conditioning scholastic success. Efforts to 
establish a certain point indicative of certain failure or certain success have 
not been entirely satisfactory, the prediction being yet in terms of prob- 
abilities rather than certainties.* 

The tests have indicated the threshold of intelligence or capacity below 
which success in college cannot be expected, although there is no general 
agreement as to that threshold.* But while their predictive value has not 
been perfect their use has played a more important part in directing atten- 
tion to the necessity of diagnosing individual differences in abilities and inter- 
ests and in taking into consideration a large number of other factors which 
may enter into the determination of academic success. Among such factors 
are health, methods of study, financial status, earnestness, and perseverance, 
selection of courses, time devoted to extra-curricular and social activities, 
and so on. In other words, the result of the effort to discover a more reliable 
method than the traditional examination for selecting students for college 
has been twofold: it has shown that a higher correlation can be secured be- 
tween a test like the Thorndike College Entrance Examination and la I c'r suc- 
cess in college, and that even such a test cannot be relied upon alone for 
purposes of prediction. Accordingly attention has been directed to the im- 
portance of guidance in education and the desirability of providing cumu- 
lative records about each student, covering every aspect of his personality 
which the adviser should Icnow if guidance and counselling are to be effective. 
Thus Professor Strang reports that 

At Colgate University, during a period of three years, about three-fifths 
of the failing students were found to have intelligence test scores below ihe 
average for the campus. There was a marked difference in the ratio of fail- 
ing students above average in intelligence to failing students below aver- 
age in intelligence in the freshman and sophomore classes. It appears that 
freshman students below average in intelligence withdraw from college 
leaving students in the upper classes who are more lilcely to fail because of 
emotional or other factors. Freeman, using The American Council Psycho- 
logical Examination, reported a marked tendency for the “students in the 
higher deciles to achieve better averages, to encounter fewer scholastic 
difficulties, and to survive a greater number of terms.” But scores in the 

1 W. F. Reeves and J. D. Russell, “Some Aspects of Cunent Efforts to Improve College Instruction." 
Bulletin of the Bureau of School Service, Vol I, No. 2. December, 1928, p. 14. Published by the Uni- 
versity of Kentucky. 

^ The difficulty is intensified further by the great variety of standards in the colleges themselves, as 
revealed in the Pennsylvania Study (see pp. 133 ff.). 
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lower deciles were not clearly indicatives of failure. Nearly half of those in 
the lowest decile succeeded in completing the full course, though with 
great difiBculty.'- 

After considering a number of criteria of prediction which have been at- 
tempted, Professor Strang concludes that 

Predictions based on the data from cumulative records, involving as 
they do the many-sided aspects of the individual seem to be the most 
satisfactory basis on which to advise boys and girls concerning their fur- 
ther educational plans. The cumulative record prevents a single non-tyjii- 
cal performance from being given undue weight. None of the criteria can 
predict, with the certainty that the term implies, an individual’s success in 
college. It must not be assumed, however, that the fault lies wholly in the 
criteria. The unreliability of college marks and the inadequacy of college 
courses are responsible in large measure for the imperfect results.^ 

The search for criteria of predictability resulted in the recognition that 
no single measure could be perfect and that the problem merges into the gen- 
eral problem of guidance which in turn raises the whole question of the mean- 
ing and purpose of education. It may, indeed, be possible to define the thresh- 
old of intelligence required for success in college work, to predict in general 
that one student is likely to succeed and another to fail. This, however, in- 
volves the assumption that the present arrangement of the college curricu- 
lum is adequate to meet all types of abilities and aptitudes. The lack of a 
perfect measure of predictability of college success, with the recognition of 
the importance of guidance on the principle that the function of non-pro- 
fessional educational institutions, especially publicly supported schools and 
colleges, is to discover the abilities and interests of students and to direct 
them into channels of study from which they can best profit, has led to the 
application of the new examination techniques to wider uses. It is not enough 
to discover that a student is likely to succeed in college; there is the further 
task of discovering the types of courses in which a student is most likely to 
succeed. There has accordingly been developed and used in many colleges a 
series of placement tests whose purpose it is to discover the actual achieve- 
ments and aptitudes of students in the various branches of a liberal or general 
education — English, foreign languages, mathematics, sciences, and the social 
studies. The placement tests, of the new objective type, follow the principles 
and varieties of this type of examination which have already been indicated. 

^ Ruth Strang, Personal Development and Guidance in College and Secondary School, p. 88 (New York, 
1934). 

2 R. Strang, op. oiU, p. 133. 
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The student adviser uses the results of both the intelligeiiee and placement 
tests as the basis for recommending the choice of programs of study. At Co- 
lumbia College the Thorndike College Entrance Intelligence Examination 
and a variety of placement tests are used in advising students ; 

Freshmen are sectioned, on the basis of the Thorndike examination, in 
their course in Contemporary Civilization, and in other required courses, 
in from three to five sections, the placement tests being used for initial 
guidance in making detailed adjustments. It is the policy of the College to 
treat each individual case on its own merits and to consider the most 
comprehensive and accurate information obtainable concerning each stu- 
dent before making a decision. Cumulative records of comparable informa- 
tion covering the student’s early years in school are lacking. The record of 
early years in school would be of great assistance to the adviser, especially 
since the average reliability of the tests as given at Columbia is only about 
0 80, and since tests merely serve to give present status and not the domi- 
nant trends of development and interests of a student nor the underlying 
history of a ease. 

At Columbia tests are used not only for placement bul for continuous 
replacement throughout the student’s entire work at Colk'gc, whenever 
it seems desirable. Tests are repeated or new tests are given throughout 
the first and second years. In the fall of 1928, the placement tests rc.su] i ed 
in the saving of an aggregate of about 1700 units of college work by pro- 
moting students in English, foreign languages, and mathematics beyond 
their official entrance status. On the other hand, a considerable number of 
students were demoted below their entrance credit status because of de- 
ficiencies shown in the placement tests. Students are encouraged to con- 
sider their placement as tentative and every student has the constitutional 
right of petition to raise or lower his placement at any time during his col- 
lege career There is thus built up for each student a mass of centralized 
and correlated information, with comparable tests related to local stand- 
ards based on several years of accumulated data.^ 

The shift in emphasis in the use of tests is brought out in the following sum- 
mary of the status of Achievement Tests in Colleges and Universities; 

I he studies during the past three yeai’S have extended the uses of achieve- 
ment tests in college. Formerly, their uses were usually restricted to mark- 
ing students. More and more they have been used in selecting and guiding 
studenis, in predicting college success, in placing students within courses 
and within sections of the same course, in assigning advanced college credit 
on the basis of examination, in awarding scholarships, in studying the 

1 A. S. Raubenheimci and P. C. Touton, “Present Status and Use of Objective Tests m Institutions of 
Higher Learning. National Society of College Teacheis, Yearbook XVIII, 1930, p. 79. 
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characteristics of college students, in granting diplomas or honors, in study- 
ing the effectiveness of educational procedures, and in evaluating teaching 
ability. The variety of uses is a chief reason for the barrage of criticism 
which has been directed against many of the tests constructed during the 
past ten years. The commonly accepted technics of test construction do not 
produce tests appropriate for such varied ’usage. ^ 

One result of the experimentation in the field of examinations which has 
been conducted during the past fifteen years deserves mention. The search 
for a measure of prediction failed to some extent because of the unreliability 
of instructors’ marks which were given as a rule on the written or essay form 
of examination; that is to say, the attempt to correlate results obtained on an 
objective basis of new type tests and grades or marks assigned on the basis 
of subjective opinion was found to defeat the ends of the new experiments. 
Here and there college instructors had already begun to experiment in their 
own classes with new type tests. Their use on a large scale was introduced at 
Columbia College in connection with a new course on Contemporary Civiliza- 
tion required of all first-year students. Greeting them at first with skepticism 
instructors soon became convinced of their utility; in some cases perhaps they 
became too convinced, since the value of the essay examination was in danger 
of being depreciated, and more particularly by those who had been in the 
habit of employing it regularly than by the advocates of the new type test. 
From the experience in the course on Contemporary Civilization the use of 
the new type test spread to other fields at Columbia College, as, for example, 
physics, government, zoology, economics, philosophy, history, English, and 
civil engineering. The development of such new type tests on the content of 
a course involves the cooperation of those who conduct the course and of the 
expert in measurement. On the instructional side this means a clear defini- 
tion of the objectives of the course and of the content which students should 
be expected to master. Then, in the words of Professor Wood, 

The definition once agreed upon, the next step is to construct an. exam- 
ination comprehensive enough to satisfy that definition, objective enough 
to insure that competent examiners everywhere will secure comparable 
results, and reliable enough to make the results worthy of being used by 
administrators, instructors, and research scholars. The examination may 
be made comprehensive by the use of the New Type questions, whose 
brief recording processes make it possible to include a comparatively large 
number of each of several different lands of questions. The brevity of the 


^ R. W. Tyler and F. P. Frutchey, “Achievement Tests in Colleges and Universities ” HevAeio uf Edu- 
cational Rcscarchy Vol. V, Decembei, 1935, p 493. 
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answers to the New Type questions not only rescues a very large part of 
the examination period from irrelevant activities and considerations on the 
part of the examiners, but at the same time renders the examination ob- 
jective and reliable^ 

The experiment undertaken at Columbia College is not merely an innova- 
tion in the method of constructing examinations but represents also a break 
with the American practice in which each instructor is usually responsible 
for the preparation and marlcing of examinations in his own class. In a sense 
it introduces the principle of external examinations, except to the extent that 
instructors do cooperate with the technical expert in their preparation, and 
sets up common objectives for similar courses and standards which are com- 
parable from year to year. It introduces also another principle, that the 
function of the examination is not merely to encourage and stimulate stu- 
dents to review their work and to mark and rank them on the results, but 
also to discover more about the students’ strength and weakness and promise 
of further growth, and to advise them on the basis of the information ob- 
tained. In other words, the tendency is to look upon the examination itself 
not merely as a method of assessing achievement but as a method of cclU’ 
cation. 

Experiments with New Type Tests: University op Minnesota 

The whole problem of examinations has been attacked from this point of 
view at the University of Minnesota in general but more particularly in the 
recently established General College, which will be described more fully later 
as an experiment in educational adjustment. As Professor M. E. Haggerty, 
Dean of the College of Education, has stated, ‘Tt is still far from clearwhether 
the trend toward increased emphasis upon examinations will, in the long ruu, 
improve the quality of education. Most certainly it will not do so unless the 
quality of examinations is improved,” so that they “may safely be used to 
measure human traits and achievement, and evaluate the merit of educa- 
tional progress.” Hitherto attention has been devoted to evaluating the final 
result. “Educational research,” in the opinion of one of the instructors, “is 
rapidly forcing us to recognize that the construction and administration of 
examinations is a major part of the teacher’s job.” 

The General College has accordingly adopted and developed the practice 
of giving comprehensive examinations of the new type in all subjects taken 
by the students. The construction of the tests involves the cooperation of the 

^ Ben D. Wood, Measurement in Higher Education, p. 282 (New York, 1923). Sec also Chs VIII-XII 
of this work in which the new methods of content examining in various subjects are discussed. 
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subject matter instructor and the counsellor who is an expert in the prepara- 
tion of tests and has a general knowledge of the content of the course to be 
examined. His function is to suggest “the types of test items useful in measur- 
ing particular kinds of content or the achievement of particular objectives”; 
he guides the assistant in the course “by helping to devise items, by criticiz- 
ing and revising the items prepared by the assistant, and by directing the 
organization of the tests and examinations”; and he makes or directs 
“studies of the tests after their administration.” The assistant acts as a 
liaison between the subject instructor and the counsellor, follows the work 
of a course, studies the materials of instruction, and makes the technical 
studies under the direction of the counsellor. The instructor determines the 
teaching objectives and content of the course, acts as the final judge of the 
accuracy of the key statements in the tests, and approves the inclusion or 
exclusion of items in the test. The types of tests used include the essay, true- 
false, modified true-false, multiple choice, reverse multiple choice, multiple 
response, matching, master-list, classification, completion, controlled com- 
pletion, and arranging items. The purposes which the General College has set 
before itself in developing the system of comprehensive examinations are as 
follows : 

(1) As in course examinations, the comprehensive examinations should 
measure the several outcomes of instruction. Not only retention of factual 
materials and applications taught in class, but also ability to make prac- 
tical applications of principles to new situations and attitudes toward 
controversial subjects should be measured. ... (2) The comprehensive 
examination in a given field should extend to materials covering a wider 
range of information than is included in a course of instruction. . . . 
(3) The comprehensive examination should demand integration. Test situ- 
ations should be devised which will demand the drawing together of infor- 
mation and principles from different phases or divisions of a field.^ 

The experiments with the new type test have been continued over a suffi- 
ciently long period and under sufficient control to warrant certain conclu- 
sions . There is general agreement that the new type test has advantages which 
the essay examination does not possess: it tests a wider sampling of facts, it 
is easily and accurately scored, and it is free from "vitiating opinion which 
masquerades too often as judgment.” The essay does not, however, lose its 
importance as a method for training in power of expression and ability to 
organize material, and it can further be used as a test of these qualities, and 

^ E A Carstaler, “The Plan m Opeiation,” in Studici in College Exanunatiom, pp, 3 1 f. (Minneapolis, 
1031 .) 
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as an exercise should be dealt with separately. A special study of Essay and 
Objective Examinations in English Literature concluded that ‘ much that is 
being measured with essay tests can also be measured with objective exam- 
ination items, for on both types students obtain similar ratings.^ 

On the other hand, it is becommg equally clear that certain educational 
values cannot be measured by objective tests; among these is the ability 
to discuss a topic in the social sciences, clearly, convincingly, and agree- 
ably.”^ 

The investigations also tend to disprove the charge that the new type test 
measures only facts and information. 

The findings point to the inference that the ability to acquire informa- 
tion on the part of the students in these General College courses has been 
accompanied to a substantial extent by the ability to apply this informa- 
tion. The measurement of the extent to which this association occurs is 
an inherent part of a valid examination in those courses where the objec- 
tives of instruction include the ability to use, as well as to acquire knowl- 
edge.^ 

The same conclusion as this was reached in another study, “Testing the 
Understanding of Ideas,” and is expressed as follows by the investigators : 

It has been shown that the testing program in “Background of the 
Modern World” involved the student’s ability (1) to discriminate, (2) to 
recall or establish sequences, relationships, and associations, and (3) to ap- 
ply and contrast generalizations. Thus the examinations measured some 
aspects of complex mental processes. No matter how inclusive a definition 
of ideas is set up, it seems clear that the test forms described in this article 
do test mental activities which would fall within the range of such a defini- 
tion. No one would claim that the forms measure all kinds of ideas. All that 
is claimed for them is that they measure some of the more advanced forms 
of mental activity^ 

Finally, “the chief advantage of improved examinations accrues from the 
greater possibilities afforded for reliable uses,” that is, for diagnosing a stu- 
dent’s special abilities and difficulties as a basis for guidance and advice. The 
methods of scoring and recording the results make possible the development 

1 A. C. Eunch and F S. Appel, "Essay and Objective Examinations, in Eiielish Literatuie,” m Studies 
in College Examinaiions, p. 9T. 

2 A. C Krey. “Differential Functions in Examinations,” o/tte VnimTsity of Minnesota, Uni- 

ver&ity Committee on Educational Reseaich, Vol. XXXVI, No 4, January 35, 1933, p. 12. 

^ P O. Johnson, Ditlerential 1’ mictions of ExaminaUons,” in Studies in College Examinations, p. 41. 

^ E. R. Wesley and R R. Wesson, “Testing the Understanding of Ideas,” in Studies in College Ex- 
aminations, p. 73. 
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of profile charts which with other relevant information may present a com- 
plete picture of the physical, emotional, and intellectual characteristics of a 
student. Hence 

With improved examinations and with the students’ ratings shown on 
profiles the educator and counselor is in a better position to diagnose diffi- 
culties that may be ameliorated just as the physician is better equipped 
to treat a patient the more refined his diagnostic techniques become. The 
profiles described above (in the text) are a beginning in this direction. 
They are promising only to the extent that they are based upon a reliable 
and valid testing program which is far reaching in the outcomes it seeks 
to measure.^ 

Following a suggestion of President L. D. Coffman the University Com- 
mittee on Educational Research of the University of Minnesota appointed a 
Committee on Examinations in 1931. Since that time the practice of using 
new type tests to replace or to supplement the traditional examinations has 
been extended beyond the General College to other divisions of the University. 

Experiments with New Type Tests: University op Chicago 
The University of Chicago furnishes a third example of the extensive use 
of the new type test. Under a plan which was adopted in 1930 the University 
abandoned the peculiarly American organization of college education on the 
quantitative basis of credits. Students may now pass from the Junior to the 
Senior College as soon as they have shown that they have satisfactorily met 
the requirements prescribed for the Junior College entirely irrespective of 
the amount of time spent or the courses taken. They must pass examinations 
in four major fields : humanities, social sciences, physical sciences, and biolog- 
ical sciences. Class attendance is optional and examinations may be taken 
at any time when they are offered. Special importance is accordingly at- 
tached to the examinations, which are prepared with great care “to insure 
that the questions adequately represent the sort of mastery that the in- 
structors have in mind and that the student is given ample opportunity to 
demonstrate his degree of mastery over a wide section of the course.” The 
method of preparing the examination is similar to that used at the Univer- 
sity of Minnesota except that the examiners themselves attend the lectures 
in the general courses and frequently consult the instructors, who in turn 
approve the questions in their subjects. The instructor may use tests in his 
course at any time, but the final comprehensive examinations are constructed 


^ A. C. Eurich, “Individual Diagnosis,” in Studies in College Examinations, p. 86. 
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by full-time examiners. The system thus aims to divorce the function of ex- 
amining, marking, and awarding credits from the function of instruction, a 
practice which m some way may be compared with the external examinations 
in England and France.^ The forms of tests which are used are similar to those 
already mentioned; an attempt has been made to improve the essay form, but 
in this attempt as in all others with a similar aim the spirit of the essay dis- 
appears in favor of a closer approximation to the new type test.^ 


Statewide Testing Programs 

One of the serious difficulties confronting American education is the ab- 
sence of common standards of a comparable character throughout the country . 
There is no central authority for education either for the country as a whole 
or for the separate states which assumes the right to impose standards of 
attainment on educational institutions or to test for such standards. The 
tradition is strongly in favor of local autonomy, and, while such autonomy is 
salutary from one point of view — ^the adaptation of education to local en- 
vironments — from another it has resulted in a great variety of standards 
which is only intensified by the fact that teachers, whose qualifications also 
vary throughout the country, conduct their own examinations in their own 
classes and that recommendations for admission to colleges are based on their 
results. With few exceptions, such as the College Entrance Examination 
Board and the New York Slate Board of Regents, the practice of external 
examinations for secondary school pupils is virtually unknown and is in any 
case suspect lest they control curricula, courses of study, and methods of in- 
struction. There are, of course, regional standardizing agencies® which 
have made important contributions to the definition of the scope of secondary 
school work, of its relations to colleges, and of standards of a quantitative 
nature, such as length of school year, length of class periods, size of staff, 
pupil load, preparation of teachers, teaching load, and buildings and equip- 

1 M. A Desdos in .summarizing the results of the Fiench Committee’s investigation on the scoring of 
the examination for the baccalauriat states as the first conclusion that ‘‘A selection should be made 
among examiners The art of examining demands qualities which are quite different from those re- 
quired for the ait of teaching. One may be an excellent teacher without necessarily being a good ex- 
aminer and theie is no moie reason for being offended on this account than because one is not a good 
musician.” La Correction des Ljtrewces Eerites dans les Bxamens, p, 379 (Pans, 1936). 

2 For a description and examples of the tests see the Manual of Examination Methods by M. W. Rich- 
aidson, J. D Russell, J. M. Stalnakei, and L. L. Thurstone (University of Chicago Bookstore, 1933). 
2 Among these aie the North Central Association, the Middle States Association of Colleges and Sec- 
ondary Schools, the Association of Colleges and Secondary Schools of the Southern States, and the 
Northwest Association of Secondary and Higher Schools See I. L. Kandel, Ihstory of Secondary 
Education, pp. 466 IF (Boston, 1030). 
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merit. The system of accrediting institutions and in some states inspection of 
high schools have contributed to the same ends. But in general it has been 
assumed that the quality of instruction could be depended upon if the quan- 
titative standards 'were sound. There is further a surprising variety in the 
methods of admission to college and in the specific subjects required. The 
following table indicates the most common combinations of entrance criteria 
for regular students employed in 517 colleges:* 

NUMBER OF INSTITUTIONS INCLUDING CERTAIN ITEMS IN THEIR MOST 
COMMON COMBINATIONS OF ENTRANCE CRITERIA FOR REGULAR STUDENTS 


Ci itei ion 

Frequency 

Rani, 

Tiansonpt of high ichool credits 

318 

1 

Recommendation of principal 

262 

2 

Persona! intei views with applicants 

1.38 

3 

Rank in high school graduating clasb 

135 

4 

Recommendations by peisons other than the pnneipal 

133 

5 

High school diploma 

131 

6 

Character rating 

136 

7 

Presentation of high school subject ecitifieates 

118 

8 

Examination devised and administered by institution 

101 

9 

College Entrance Board examination 

93 

10 

Intelligence test 

93 

11 

College aptitude test 

53 

13 

Other examination (Regents, State Board, etc.) 

44 

13 


The subjects required for entrance also vary widely. “A few institutions 
have no subject requirements at all, a few others have requirements only in 
English, and others specify the subject matter for nearly all the 15 units 
which are usually required for admission.”^ 

With such variation in the standards of the high schools and in the methods 
of admission the Important issue has arisen of defining more adequately than 
has been done in the past the meaning of “fitness for college education.” On 
the one hand, students have been admitted more or less automatically on 
graduation from accredited high schools, with the result that a large number, 
ranging from ten to thirty per cent, found themselves incapable of continu- 
ing their studies beyond the first year. On the other hand, the situation has 
been aggravated by the constant increase in the numbers of students pro- 
ceeding to college after the War and particularly during the period of the 
depression. In private institutions selective barriers could be maintained; in 
publicly maintained institutions this has not been feasible partly for political 
reasons, partly because of the American tradition of equality of opportunity. 


1 United States Ofiice of Education, National Survey of Secondary Education, Bulletin,, 1932, No. IT, 
Monograph No. 10, Articulation of High School and College, p. 19 (Washington, D. C., 1933). 

2 Ibid., p. 30. 



106 


THE SCIENTIFIC ATTACK ON EXAMINATIONS 


To some extent the problem is being met in the high schools Ihcniselvos, for 
example, in New York State and California, by the adoption of two types of 
graduation certificates, one attesting the completion of the course, the other 
entitling the student to admission to the state college. Another practice 
which is still in its initial stages is to establish within the college a system of 
counseling and advice which will enable the student to discover the types of 
courses from which he can profit. 

There is greater promise, however, in another method of meeting the diffi- 
culties in this situation and that is the utilization of objective methods of dis- 
covering fitness for college studies — ^in other words, the application of methods 
of testing. Examinations of the new objective type are conducted in a number 
of states by organizations which are connected with the state university or 
with a number of higher educational institutions in a state: they are also 
administered by organizations which are national in scope. This develop- 
ment has the important advantage of establishing comparable slaiulards 
over larger areas, of defining in a qualitative way educational standards for 
the high schools, and of meeting the objections to the Iradiiioual method of 
examinations. To meet the objection which is still raised against the eoevcivi' 
influence of external examinations it is argued that the new sysb'iu does not 
prescribe a syllabus of studies to be followed by the schools aiid that Hu; new 
type tests are based on the actual work done or professed to be done, and the 
courses of study and the texthoolis used by the schools; that they furnish a 
more reliable basis for comparing schools because they are objective; and 
that they are fair to all students at the same stage of development because 
they have validity and are comprehensive samplings of the work accom- 
plished.* 

Such tests have been employed not only to discover fitness for college edu- 
cation, but they have led to the discovery of large numbers of boys and girls 
who are intellectually able to continue their education but who for various 
reasons may decide not to do so. The tests can thus be used for the discovery 
of students of normal and superior ability at one end of the scale; at the other 
end they may be used to discoui-age pupils of low ability from proceeding 
beyond the high school. 

Among the states which have developed systems of statewide testing of 
high school students, generally in their senior year, arc Alabama, Colorado, 


1 There stiU remains the objection which comes from progressive educators that this system merely 
f existing definitions of secondary education and prevents radical experimLtalion with 
he secondary school curriculum. It is to be noted, however, that the thirty secondary schools which 
whicT m!fiindeSr^^''‘"'“ subjecting themselves to objective measurements in the work 
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Georgia, Indiana, Iowa, Kansas., Michigan, Minnesota, Montana, New 
Hampshire, Ohio, Pennsylvania, South Carolina, Texas, and Wisconsin! 
Only a few typical examples can be discussed here. 

Statewide Examinations. Ohio 

The increasing demands for admission to college in Ohio led to the con- 
viction that the problem must be considered not from the point of view of 
excluding students but from the point of view of developing measures for 
discovering those who are likely to profit from a college education. The prob- 
lem in other words is to find the right land of education for the students at 
the right time, and with the rapid social and economic changes Ihe greatest 
need is a fundamental sorting out of the things most worth knowing about 
students. While high school marks over a four-year period would be predictive 
of success in college, such marks do not at present mean the same thing in all 
high schools. Hence as many different avenues as possible for securing reliable 
information about students must be explored through an extensive system of 
guidance, which would include: (1) An annual intelligence test of every high 
school student in the state in order to obtain a reliable measure of intellec- 
tual promise; (2) Annual transmutation to a common basis of the marks of 
all high school students in the last year of their course in order to yield a 
comparable prognostic value; (3) The assignment of a teacher in each school 
to serve as a guidance counsellor; (4) At least one guidance interview for each 
pupil once a year; and (5) The adoption of a uniform cumulative record blank 
with a lime projection giving an account of a student’s abilities, attitudes, 
plans, ambitions, etc. In the interests of each individual student and for the 
good of society the present selective and coercive measures must he surren- 
dered in favor of adapting education to the needs of each student.^ Since a 
college education for all is pedagogically unthinkable both because of ihe 
present organization of college education and because of the danger of voca- 
tional overcrowding, the following principle must be accepted' 

In counting the cost of education, we should count the cost to society, 
not merely to the state, the college, the student, or his parents, for example, 
but to all of these. And, if the risk of academic mortality to an individual 
is great, we should either avoid the risk, eliminate it, or failing in that, 
hedge against the inevitable loss to the individual where he fails. As a 

1 See D. Segei, National and Slate Cohperaiive High School Testing Piogmms. U S Office of Educa- 
tion, Bulletin, 193S, No. 9 (Washington, 1933) 

^ Sec H. A. Toops, “A Minimal Guidance Progiam for Secondary Schools.” Ohio High School Bulletin, 
No. 9 (Ohio State University). 
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corollary, the individual should accept his rcsponsibilily for his risk, bui 
this is impossible unless he be informed of his riskd 

There has accordingly been developed the practice of applying the Ohio 
College Association Intelligence Test to each student in the sophomore and 
senior years in high school. 

The test consists of five basic tests, the time on each test being long 
enough to give a high reliability on each subtest, so that a pupil may be 
retested to determine whether he has a specific weakness in any of the sub- 
test abilities — arithmetical reasoning, same-opposites vocabulary, gram- 
matical analogies, number completion, and reading comprehension.^ 

The test, which has a validity coefficient of .55 to .60 in predicting fresh- 
man college success in liberal arts courses, is used by some fifty colleges and 
teacher training institutions in the State. The test has the merit not only of 
predicting college success and thereby discouraging from t'nLrance students 
who are likely to fail, but also of encouraging .students of ability who ollier- 
wise would not have continued their education. Ample stalls Lieal evidence 
is available to correlate ability as shown by the test scores with degree of 
success in college. At the same time it is recognized that the ini elligenw' Le.sl s 
alone cannot tell ihe whole story about a student, since they fail “lo niea.siire 
important character traits — such as industry, persistence, conscientiousness, 
enthusiasm, seriousness of purpose, and those other factors which have a real 
bearing upon success.” Hence the suggestion already mentioned of supple- 
menting such test scores by information collected on a cumulative record 
card. It is, however, claimed that the results of research based on the tests 
are immediately translated into practice by the high school principals to 
whom they are circulated in advising students on their educational careers. 

It might perhaps be objected that the same results could be achieved by 
the traditional examinations, but the objection ignores a number of facts. 
First of all the traditional examinations set up an arbitrary standard of “pass” 
or fail , the results do not furnish the basis for an exact comparison of a 
large body of students such as is provided when they are arranged on a per- 
centile scale; nor do they indicate, as extensive intelligence tests over a large 
area may do in time, if not already, the kind of education from which a stu- 
dent is most likely to profit. Attention must again be drawn to the fact that 
no reputable expert in the field of measurement makes any deterministic 

1 Ohio College Association Bulletin, No. 61, p. 659. 

Cdumbur^O ^19297”' Quidanoefor High Schools, p. U (Ohio State University Piess, 
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claims for intelligence^ tests and that the need of as wide a range of infoima- 
lion as can be secured, covering not merely scholastic ability but all those 
traits that are connoted by the term “personality,” is coming to be widely 
recognized. 

In addition to the college aptitude test conducted by the Ohio College 
Association the State Board of Education of Ohio conducts tesls in the ele- 
mentary and high schools which are used chiefly by schools outside of the 
large cities. The tests are given by the principals, superintendents, or teachers, 
who score them and return the tabulated results to the State Department of 
Education which reports the final results in such a way that each school can 
compare its own average score and the score of each pupil with the scores for 
the whole State The tests thus serve the purpose of motivating and improv- 
ing instruction and make possible diagnosis of difficulties and remedial treat- 
ment; the second of these purposes can obviously not be met by the general 
reports which are made on the basis of the traditional examination. The State 
Board of Education also conducts a general scholarship test for high school 
seniors, specially selected by their schools for scholastic ability, promise, and 
character. The results of this contest are transmitted in turn to the colleges 
and universities of the State.^ 

Statewidis Examinations: Iowa 

The Iowa Every-Pupil Achievement Testing Program was instituted by 
the College of Education and the Extension Division of the State University 
of Iowa in order to develop a regional system of cooperative testing for the 
high schools of the State and ‘To provide superior instruments for the meas- 
urement of educational achievement, to encourage better scholarship, and 
to accelerate improvement in the content and methods of high school in- 
struction.” While the existence of agencies for the production of standardized 
tests in various school subjects is recognized, it is felt that they are inade- 
quate and scattered and sporadic in their use and not adapted to conditions 
within relatively restricted geographical regions. For the Iowa Evcry-Pupil 
Testing Program the following advantages are claimed: 

It is an annual cooperative program conducted for schools operating 
under relatively homogeneous conditions in a restricted geographical area; 
all materials are expertly constructed on a uniform basis under central 
supervision, resulting in high consistency in quality and in form from sub- 

1 It IS unfortunate that this teim still continues m general use; the more recent term, “scholastic apti- 
tude test,” lb moie appropriate. 

^ D. Segel, op. cU., pp. 26 f. 
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ject to subject; all materials are revised annually in order to keep llieiu in- 
timately related to the instructional programs in the schools anti to keep 
them abreast of recent technical advances in test coustrucLion; norms are 
simultaneously established for all tests on the same group of pupils and 
schools, resulting in high comparability from subject to subject; and the 
very large numbers of pupils and schools involved make possible the es- 
tablishment of specialized and localized norms far more reliable and mean- 
ingful than those provided for the usual standardized achievement test, 
including separate norms for pupils at different levels of general intelli- 
gence, and norms for a single composite measure established upon the re- 
sults for all pupils in all subjects in each participating schoold 

The same tests are administered on the same day to all the pupils (more 
than 40,000) in the cooperating high* schools, and norms arc established each 
year on the results from all the schools. The results of each year offer bases 
for comparison of each school with its previous records and with other schools 
and for following the progress of each pupil from year to year. 'The re])orls 
on the tests have the further value of directing altention to weaknesses in 
instruction; they are thus diagnostic in character and suggest the natui-e of 
remedial instruction needed. They may accordingly conlribule to a program 
of educational guidance and improvement of instruction. For the research 
student they furnish material for the investigation of such pressing ami 
crucial problems as “the relationship of class size and academic achievement, 
between size and type of school organization and results achieved, or between 
such factors as the training and experience of teachers and the achievement 
of their pupils.” The experience of a few years has already led to some impor- 
tant conclusions on the content and methods of instruction. 

Experience gained through this project during the last three years has 
yielded conclusive objective evidence that high school instruction is, in 
general, overly dependent upon the textbook, that mechanical, rote pro- 
cedures tend to predominate in learning and in recitation, and that what 
pupils actually acquire as a result of instruction frequently consists, m 
large measure, of a mass of more or less meaningless verbalizations. Pupils 
tend to depend upon the recall of “pat” expressions taken from the text- 
book and upon words and phrases which have been memorized with no 
appreciation of their meaning or significance, rather than upon a reasoned 
understanding of the concepts involved. This type of learning has perhaps 
been encouraged in part through the use of poorly constructed examina- 

^ E. P. Lindquist, The Icnoa Every-P^ipil Achievement Testing Program, p. 6. Bulletin of the State Uni- 
versity of Iowa, New Series No. 716, December 2, 1933. 

2 The testing program has now (1936) been extended downward to include the upper grades of the 
elementary schools. 
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tions of a highly informational character, such as have often been prepared 
by classroom teachers for informal testing purposes or such as have fre- 
quently been provided in Ihe past by standardized test agencies. 

It must be recognized that many standardized testing programs or other 
examination procedures — notably certain slate board examinations — 
have tended to perpetuate these undesirable practices in teaching. The 
sponsors of the Every-Pupil Testing Program have been Iccenly aware of 
this truth and have been constantly on guard against dangers of this type. 
They believe they have demonstrated during the last three years that it is 
possible to conduct a regional testing program in such a way that these 
practices will be definitely disconrayed, rather than perpetuated. The Every- 
Pupil tests are constructed with the conscious and deliberate purpose to 
defeat rote learning of, or mechanical and verbal drill upon, poorly selected 
and isolated information. In them, an effort is made to avoid the use of 
stereotyped textbook language; to call for applications rather than state- 
ments of laws and principles; to requu-e the interpretation of real problem 
situations, rather than the repetition of words; to place the emphasis upon 
interpretative ideas rather than upon descriptive information only; and 
to require the pupil to draw inferences from, or to recognize the implica- 
tions of, facts rather than merely to recall the facts themselves.^ 

Sixty -minute tests are available in the following high school subjects:^ 
Ninth Year Algebra World History 

General Science American History 

First Year Latin American Literature 

English Correctness 9* English Correctness 11* 

Plane Geometry Physics 

Second Year Latin Economics 

Biology American Government 

English Correctness 10* English Literature 

English Correctness 19* 

‘f'In this subject, the same test is administered in all four grades. 

Each school decides on the tests to be used but every pupil must be sub- 
mitted in the subjects chosen. The tests are administered and scored in each 
school, to which a Summary Report of Results and a special confidential 
report is subsequently sent by the College of Education. The report shows 
(1) the average score made on each test in the school interpreted for each 
school in relation to rank position, T-score value, and size of school; (2) a 
composite measure of performance of the school in all subjects (rank posi- 

^ Ibid., pp. 7 f. See also ‘‘A Coflperative Testing Program for Iowa Elementary Schools,” pp. Id ff. 
Bulletin of the State University of Iowa, New Series No. 7G0, October 6, 1934. 

^Ibid., p 11. 
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tion, percentile position, etc.); (3) frequency distribution of average score 
for all schools, of composite measures, of the average scores of the schools 
in each enrollment group, and of the raw scores of individual pupils for all 
schools. 

The signiScant characteristics of the norms furnished for the Every 'Pupil 
tests are claimed to be as follows : 

1. They are based upon a sufficiently large number of schools and pupils 
to establish their reliability beyond any question. 

2. They are established only for schools within a restricted geographical 
area and therefore for schools that are operating under essentially the 
same conditions. 

3. They arc expressed in terms of school performance as well as in terms 
of pupil performance. 

4. Separate norms are established for separate enrollment groups. 

5. The norms are highly comparable from subject to subject 

6. Norms are established for composite school achievement as well as for 
achievement in individual subjects. 

7. Separate norms are established for pupils at different levels of scholastic 
aptitude or general intelligence.^ 


Statewide Examinations: Wisconsin 
Another example of statewide codperation in conducting, as it were, a 
census of the intellectual resources in the youth of the state is furnished by 
Wisconsin, where it was found in 1930 that there had been an increase of 
over 400 per cent in the enrollment in high schools and colleges in twenty- 
five years as compared with an increase of only 33| per cent in the popula- 
tion. This increase in the student body has been accompanied by “the serious 
tragedy of student mortality” with the consequence that 

Everybody has considered whether it might not be possible to prevent 
some of the mortality by analyzing individual cases and trying to detect 
those who are doomed to failure if college work is attempted, by a discov- 
ery of those who have superior college ability and by analyses of individual 

^ Idl'd. f pp, 16 f. The tests used in. the Program are sold at four cents a copy, on the basis of thiee or 
four tests the cost for each pupil averages fiom twelve to sixteen cents, and a full testing program for a 
school of 100 pupils would be about $15, No charge is» made for descriptive pamphlets, manuals of 
directions, scoring keys, and the final summary reports. The cost of constructing and pnniing the tests, 
of preliminary experimentation with materials, of the statistical analysis of lesults, and of the prepai a- 
tion of th e report is met out of income derived from the sale of tests The cost of personnel is met by the 
University. The Program is, therefore, non-piofit making The College of Education also conducts the 
Every-Pupil Contest, a competitive test between schools; the State Scholarship Contest, a competitive 
test for individual students; and since 1934. the Iowa Every-Pupil Elementary School Testing Progiam, 
described in the Bulletin of the State Universiti/ oflowa^ New Series No. 760, October 6, 1934. 
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interests and aptitudes which shall serve as a more intelligent basis for 
making life decisions d 

The problems raised by this situation, affecting as they do the fundamental 
problem of the distribution of education “point the way to the need of experi- 
mentation” and constructive cooperation. To this end a State Committee on 
Cooperation was created in 1928 with representation from the High School 
Principals’ Association, the Association of City Superintendents, the I’ri- 
vately Endowed Colleges, the Stale Teachers Colleges, and the State Univer- 
sity, and with participation in an advisory capacity of the State Department 
of Public Instruction. The philosophy which guided the work of the Com- 
mittee was defined as follows : 

That educational opportunity shall be viewed as a broad highway ex- 
tending from Idndergarten to college graduation and that every child has 
a right to travel this highway as far as his native interest, capacity and en- 
dowment will permit. If this philosophy is sound then the committee felt 
that it must think of its problem, not in terms of that democratic principle 
which insists upon the political equality of human beings but in terms of 
the principle of biological inequality of human beings. While the committee 
subscribed completely to the principle of equality of opportunity it recog- 
nized just as completely that equality of opportunity means, not identity 
of opportunity but diversity of opportunity. The committee hoped that 
it might be successful in giving additional impetus to a program which 
should result in a keener realization by the schools of the state of the re- 
sponsibility of education to analyze every boy and girl for native aptitude, 
and to know him as an individual, to the end that every student as he 
travels the broad highway of education may be assisted in an adjustment 
to that combination of circumstances in life which give, for him, the great- 
est promise of success and happiness.* 

To carry out the program suggested by this philosophy, the Committee 
first secured an improvement in the admissions blanks used by colleges and 
universities in order that secondary .school principals might be encouraged to 
assemble as much information as possible about each student and that col- 
lege authorities might create a system of counselling and advice on the basis 
of this information. The improvement of the admissions blank led, secondly, 
to the appointment of a sub-committee to draw up a cumulative record card 
which “would tend to make judgments of pupils more objective.” The third 

1 V. A. C, Henmon and F. 0. Holt, "A Report on the Administration of Scholastic Aptitude Tests to 
34,000 High School Seniors in Wisconsin in 1929 and 1930,” p. 6. Bulletin of the TIniuersity of Wis- 
consin, Semi No 1780 (Madison, Wise., 1931). 

® Ihid., pp. 6 f 
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task was the cooperative testing program on the basis of whicli (1) compara- 
ble standards could be established for the high schools of the state, (2) rat- 
ings of ability to do college work could be stated in such forms as to enable a ’ 
teacher to advise pupils and parents more intelligently, frankly, and conli- 
dently, and doubtful students could be advised against proceeding to college, 
while superior students who otherwise would not have continued their edu- 
cation could be encouraged to go on. 

The Committee decided first to use the Ohio State University Psycholog- 
ical Test (see p. 106) because of its demonstrated reliability and validity (.55 
to .60) ; from 1930 on the American Council Psychological Examination was 
used because its validity was as high as that of the Ohio test and because it 
was less costly. The cost of administration was divided between the partici- 
pating colleges. The tests were conducted on one day, were administered by 
the high school principals, and were then sent to one of the colleges to be 
scored. The final check of the tests and tabulation of all data were made by 
the Bureau of Guidance at the University of Wisconsin. In 1929 the tests 
were taken by 16,619 seniors, out of an estimated total of about 17,000, in 
434 public and 14 private and parochial secondary schools.^ Reports on the 
results of the test were made to every high school and gave the percent.ile 
rank of each senior tested ; similar reports were made to the colleges which 
the students had indicated as then' probable choices. 

The results of the tests applied to a supposedly homogeneous group — high 
school seniors — revealed an extraordinary range of individual differences : 

While the ablest graduate makes a point score of 335 or over out of a 
possible 395, the poorest makes a point score of 30 or less. While the top 
five per cent make point scores of 240 or over, the lowest five per cent are 
making scores of 100 or less. Each of these are high school seniors, poten- 
tial candidates for admission to higher institutions and further academic 
work.^ 

Obviously mere graduation from high school cannot be accepted as having 
any value for predicting success in college; it must be supplemented by some 
other information, an important part of which is furnished by a comparative 
test of the kind undertaken by the Committee in Wisconsin. Certainly the 
test used has sufficient reliability and validity to warrant a warning to cer- 
tain groups of students on the percentile rank in the state of the likelihood 

1 In 1930 appro-ximately 17,000 seniors were tested m 42S public and in 28 private and parochial schools; 
in 1931 a few over 20,000 seniors were tested in 4.31 public and 23 private and parochial secondary 
schools^ find m 193i5 the nunilifii of seniors tested in 438 public Rnd 49 nnvatp Ri^cnndflTv RchnnlR war 
27,590; in addition 32,443 sophomores m 473 secondary schools, pubhe’^tnd private w7e £ 

2 Ibid., p. 20. 
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of failure should they undertake college studies. The test may also be used 
to encourage able students to pursue their studies further. 

Out of 1,660 high school students in the top decile, there are 450 who 
express no intention to continue but for whom further academic train- 
ing would be a good investment for society. The encouragement of such 
students in some way is clearly indicated. If we include the top two deciles, 
there would be 1,198 students who indicate no intention of going on to col- 
lege but from whose further education society might profit a thousand-fold. 
The matter of selecting individuals for training is as important for society 
as proper training for them when selected. The encouragement of those 
who are best fitted for further scholastic training is more important than 
to discourage those who do not possess the capacities for success in college. 
It should be clearly indicatefl that no stigma attaches to such ratiug.s as 
may be given by a test of scholastic aptitude. The test is not a test of gen- 
eral intelligence, whatever that may mean, but rather a test of that seg- 
ment of general intelligence which is indicative of ability to profit by fur- 
ther scholastic training. The determination of individual differences as 
exactly as is possible at the present time and the assignment of individ- 
uals to the work for which they are best fitted is as important a problem 
as there is in the whole range of pure and applied science. To say that an. 
individual is not possessed of the capacities necessary for successful college 
work is not to indicate that he may not be eminently successful in other 
fields of the world’s work The important thing is not to encourage an indi- 
vidual to engage in an occupation or set out upon an adventure in which 
he is probably doomed to failure.* 

In 1932-33 a test of mental ability began to be given to tenth year or 
sophomore students in the high schools. The statewide cooperative testing 
program in Wisconsin thus represents a twofold effort to secure comparable 
standards or ratings of ability of students at the end of their high school 
course and to use such ratings for the purpose of advising individual stu- 
dents in order that the number of failures in college may be reduced and the 
college student body in general improved. 

Statewide Examinations- Minnesota 

One other illustration of methods for meeting the large increase in the 
number of students flocking to the colleges is furnished by the University of 
Minnesota, which on the basis of the results of a testing program has imder- 

1 Ibid., pp. 21 f. It IS unnecessaiy here to do more than to indicate other i elationships which the coop- 
erative test made it possible to study, such as “sex differences in seholastic aptitude among high school 
seniors”, “occupational preferences of high school semois in relation to scholastic aptitude”, “intelli- 
gence and parental occupation,” etc. 
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taken an experiment in education beyond the high school level for students 
who do not show promise of success in the courses regularly offered to under- 
graduates. The question “Who should go to College?” has been studied at 
the University of Minnesota since 1915, when a system of counselling was 
introduced in the College of Science, Literature and the Arts. Efforts were 
made to discover methods of predicting success in college, partly to save stu- 
dents from failing, partly to advise them in the choice of a vocation and 
course of training. College aptitude tests have been developed and used since 
1917 and have involved the use of rank in high school and a psychological 
test. The average grades of each student during his high school career are 
calculated by the principals and then converted into percentile ranks to 
facilitate statewide comparisons. All students are required before entering 
college to take a psychological or college aptitude test^ the score on which is 


UminSRSITY OF MINNESOTA 
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Freshman Entei mg 1923 to 1927 Indusioe 
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^ This test vBS prepared for the Association of Minnesota Colleges, sixteen colleges including the Uni- 
versity of Minnesota, which cooperate m administering and using the results of the test. 
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also converted into percentile rank. The combined rank on high school schol- 
arship and on the test yield the College Aptitude Rating (C.A.R.). 

Studies which have been continued since 1921 have shown that college 
scholarship could be predicted with a high degree of success from the C.A.R., 
which gives a better prediction of grades than either high school grades or 
the psychological test alone. The following table which gives the C.A.R. and 
the number doing satisfactory work is based on a study of 2,212 freshmen 
entering the liberal arts college of the University of Minne.sota from 1923 to 
1927 inclusive ^ 

By satisfactory work is meant an average grade of C which is required for 
promotion to the senior college or for admission to a professional school. Of 
all the students who do satisfactory work 89.4 per cent come from the upper 
half of the college aptitude rating scale, whereas only 10.6 per cent come 
from the lower half. Of all the satisfactory students 99 per cent had ratings 
above 30. “Most of the students above 75 in the scale do satisfactory work 
while most of those in the lower part of the scale fall below the grade of C ” 
In another report of a follow-up study of 1,085 freshmen of 1923, 1924, and 
1925 it was found that only 6 of the 1,085 with a C.A.R. below 26 eventually 
graduated.^ It is recognized, however, that valuable as the C.A.R. has been 
found to be in predicting college success, the information so obtained may 
well be supplemented with additional information on a student’s interest, 
energy, industry, determination, application, and other qualities which in a 
very few cases appear to have enabled students to raise their college marks 
above the predicted level. 

The logic of the situation led to the establishment in 1928 of what is known 
as the General College intended to provide a suitable education to students 
who according to the C.A.R. were not likely to succeed in the College of 
Science, Literature and the Arts. The General College represents an experi- 
ment in adapting education to the tested abilities of the students, or, in the 
words of President Lotus D. Coffman, it is 

a new experiment, an adventure in the field of higher education. It is in- 
tended to provide a superior intellectual opportunity for a body of uni- 
versity students whose needs cannot now be adequately met by the exist- 
ing organization of the University. It will succeed or fail in terms of its 
service to students. Its courses should be open to the most gifted student 


1 From a pamphlet Who Should 6o to College?, p. 91, prepared by Dean J. B. Johnston (University of 
Minnesota, Minneapolis, 1930). 

2 J. B. Johnston, and E. G. Williamson, “A Follow-up Study of Early Scholastic Predictions in the 
Univeisity of Minnesota.” School and Society, VoL XXXX, December 1, ISSi, pp. 730 if. 
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in the University, kay student should be privileged to elect ineinbership 

in the General College.^ 

The General College offers a two-year course, leading to the degree of Associ- 
ate in Arts. To obtain this degree students are required to pass a comprehen- 
sive examination in General and Contemporary Affairs Studies and five se- 
lected from the following: History and Government Studies, Economic Stud- 
ies, Social Problems Studies, Psychology Studies, Euthenics Studies, Art 
Studies, Physical Science Studies, Biological Science Studies, and Oral and 
Written Communication Studies. By special permission students in General 
College may attempt courses in other colleges and depai'tments of the Uni- 
versity if they “wish to find out about their abilities in highly specialized 
fields of academic activity.” They may also be permitted on the basis of their 
records to transfer to other colleges of the University and to enter senior col- 
leges and proceed to a degree. 

An investigation of the experiment from 1928 to 1982 showed that the stu- 
dents in General College who at that time were definitely of low a[)tiLude rat- 
ing obtained on the average higher grades than students with a correspond- 
ing rating in previous years who attempted the regular work of the regular 
college; their grades were higher in economics, history, and lecture courses in 
science than in languages or laboratory courses in science. Of (59 out of 1(59 
students who in 1932-33 protested against assignment lo the General Col- 
lege and were admitted to the Liberal Arts College on probation 28 remained 
for only one quarter, 7 for two quarters, 11 for three quarters, and 22 com- 
pleted the second year; 10 obtained an average grade of C, and of those who 
did not obtain this grade 28 were dropped for low scholarship, 7 transferred 
to the General College, and one to the School of Nursing, 9 dropped out vol- 
untarily, and 14 continued for the second year. In 1933-34 of 100 of this 
group admitted to the Liberal Arts College 1 cancelled during the first quarter, 
47 remained for one quarter, 17 for two quarters, 35 for three quarters; of 48 
who were dropped for low scholarship 39 entered the General College and 34 


1 Quoted in “General College of the University, 1935-36,” p. 10, The Bulletin of the University of 
Minnesota, Vol XXXVIII, September 4, 1935. The Gcneial College is open according to this Bulletin 
(pp. 9 f.) to (1) Those who desire to pursue couises oi cuuicula not offered in other colleges, (3) Those 
who, foi finimeial or othei leasons, have only a limited time to give to college training. (3) Those who 
need and wish geneial oiientation in the choice of, and general preparation for, a vocation. (4) Those 
who do not salisfactoidy meet the enhance requirements of the other colleges because of lack of train- 
ing in speeiflc subjects. (5) Those who transfer fiom other institutions who do not meet the standards 
of advanced standing of the college to which they apply, (6) Those who ai e transferred by mutual agi ce- 
ment of the General College of the University and the college in which they propose to registei or are 
regnsteied. (7) Those who might not he accepted by evisUng colleges because of a lack of preparation 
to pursue their curricula. 
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failed to do satisfactory work as measured by a C grade. Of 53 students who 
transferred in 1932-34 from the General College to the Liberal Arts College 
30 did satisfactory work and 23 did not.^ 

While the General College is an interesting and, under the present socio- 
economic conditions which affect education, a desirable experiment in adjust- 
ing education to the needs and abilities of students, from the point of view 
of the present discussion it is mainly valuable a.s throwing light on the de- 
pendability of the system of measuring ability and predicting success in col- 
lege. The general conclusion of the study eonducted over a period of years is 
that 

The C.A.R. offers a dependable anil just basis for the counseling of stu- 
dents under conditions prevailing at such institutions as the University 
of Minnesota Its use for the assignment of students to different colleges 
without counseling, however, is not recommended. If so used, it should 
be limited to those students who fall below the 15 or 20 percentile level ^ 

The essential question which arises out of the practice at the University 
of Minnesota and elsewhere is whether similar results could be obtained by 
the traditional examination method in which students are generally divided 
into the “pass” or “fail” groups, and in which the results, while in the mam 
predictive for the best minds, furnish no clue to the educational abilities 
of the rest. It may further be objected that the action taken at the Univer- 
sity of Minnesota in establishing the General College represents a dilution of 
standards of scholarship and of liberal education. The question raised by this 
objection is too important to be discussed here, but it may be countered with 
two other questions : First, whether exposure to a course in which such stand- 
ards are maintained with the certainty of failure is true education for the stu- 
dents concerned, and, second, whether such standards cannot be better and 
more honestly maintained by providing for those who from the start are cer- 
tain to fail such types of courses as arc best suited to their abilities. 

The fundamental question that is raised is whether under present contli- 
tions when students in larger numbers are entering and remaining in high 
schools and colleges the task of educational statesmanship is not the distri- 
bution of the right education for the right pupil under the right teacher 
rather than selection. For the University of Minnesota at any rate Dean J. 
B. Johnston gave the answer on the basis of about fifteen years of experience 
with the new system of classifying students according to their abilities : 


^ J. B* Johnston and E. G. Williamson, loc ui , pp 737 f 
^lhid,iloc ci7., p 738. 
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Three levels of ability are recognized in classiiying students, and any 
individual who presents outstanding peculiarities is given individual treat- 
ment. The upper half of the class— that is, those entering freshmen wliose 
college aptitude ratings are above 50— are admitted without any condi- 
tions or provisions, and they are permitted to register for any curricnlum 
offered in the College of Science, Literature and the Arts. Individuals may 
be advised or required to take the course in “How to Study, and all are 
classified in English on the basis of English training tests and their college 
aptitude ratings. 

The second group includes roughly those whose college aptitude ratings 
are between 26 and 50. These students are classified in English and are 
advised to select studies that will have immediate value to them if they 
remain in college only a short time, and to postpone laboratory courses 
and languages. 

What is only advice for the second group becomes positive direction for 
the third group. ^ 

Nationwide Testing Progeams in tub United Btatjoh 
The absence of any official authority which as in European and olher 
countries has the power to set up nationwide stamlards in educalion luis 
already been mentioned. Nor, with one exception, does there exist, as in 
England, the system of external examiners through whom comparable stand- 
ards may be maintained in the field of higher education. While there are cer- 
tain advantages, such as flexibility, variety, and adaptation to local condi- 
tions, which may result from the absence of a system of standardization, with 
the large number of high schools and colleges and the unparalleled enrollments 
in these institutions the disadvantages are beginning to be recognized. Efforts 
have of course been made by the creation of accrediting agencies at both the 
secondary and college levels to secure some uniformity of practice, but in 
the main the standards which have been established affect externals — equip- 
ment, endowment, library and laboratory facilities, and size and qualifica- 
tions of the faculty.^ Equally mechanical and quantitative are the definitions 
of educational requirements in terms of units, points, and credits. 

1 J. B. Johnston, “Advising College JouttmI of Higher Ediication,YQ\. I, June, 1930, pp. 31'!' f. 

^ The movement in the direction of setting up qualitative in place of quantitative standards is discussed 
in the Manual of Acm editing Pi ocedures of the Commission on Institutions of Higher Education of 
the North Cenlial Association of Colleges and Secondaiy Schools (Chicago, 1931) See also G. F. Zook, 
“Accreditation of Secondary Schools in the Light of the North Central Association Repoit,” pp. 16 If. 
of the Repoit of the Third Ediuational Confeience of the Committees on Peisonnel Methods and on 
Educational Testing of the Araei lean Council on Education, the Commission on the Relation of School 
and College of the Progiessive Education Association, the Cooperative Test Service, and the Educa- 
tional Records Bureau (Washington, D C., 1934). 
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The I’esults have been, first, that the standards of requirements and in- 
struction are the standards of the faculty and of the individual instructors 
who conduct their own courses, and give and grade their own examinations 
in these courses, and, secondly, that there is no challenge to the student, 
once he has obtained the necessary credits in a course, to feel any responsibil- 
ity for conserving whatever achievement he may have made in it. Attempts 
to correct the defects of these pz-acticcs have been made m a relatively small 
number of institutions at the college level by the adoption of comprehensive 
examinations at the end of the course.* But in either case, whether graduation 
is based on the accumulation of a certain number of course credits or on the 
comprehensive examinations, there remains the assumption that students 
must follow and be examined in certain blanket prescriptions or mass re- 
quirements. Such a system, it is argued, sets up certain obstacles, arbitrarily 
defined in terms of general culture or liberal education or professional pre- 
requisites, and tends to disregard the student as an individual. 

College Sophomore Testing Peogram 

To meet the need of comparable standards at the college level and to pro- 
mote a movement for greater individualization of education the Central 
Committee on Personnel Methods of the American Council on Education, a 
public but not an oflScial body maintained by a number of colleges and uni- 
versities throughout the country and by grants from some of the educational 
foundations, established an Advisory Committee on College Testing. Since 
it was early recognized by this Committee that any program of college test- 
ing must take into account the secondary schools from which college students 
are recruited, the name of the Committee was changed to the Committee on 
Educational Testing. In 1931 the Committee, influenced by the progress of 
the investigation being conducted by the Carnegie Foundation in Pennsyl- 
vania, recommended the adoption of a College Sophomore Testing Program, 
which was first used in May, 1932, in 140 institutions distributed in 38 states 
and including colleges of liberal arts, teachers colleges and teacher training 
departments, junior colleges, agricultural colleges, and engineering colleges. 
The number of students who took the test was 18,134, of whom 16,411 were 
sophomores. 

According to the original proposal of the Committee the purpose of the 
College Sophomore Testing Program was defined in these terms : 

The main purpose of the tests is to throw light on the capacities, needs 
* See E. S. Jones, Cmiprehensive Examinations (New York, 193S). 
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and problems of individuals rather than to furnish a basis for inslitutional 
comparisons. The results of the testing program here suggested, when an- 
nounced, may throw light on the selection of students and the conditions 
affecting the selection; on the response of students to the formal and in- 
formal facilities for cultivation offered by the college; on the relative eflec- 
tiveness of instruction in departments; on the importance of various factors 
influencing student performance: age, home and social conditions, previ- 
ous school training, scholastic and vocational aims, extra-curriculiir inter- 
ests, faculty counsel and the like.^ 

It was hoped that the use of a testing program through the cooperation 
of colleges distributed over a wide area would make available information 
that could be used for the successful guidance of individual students in order 
to provide for their better training for the service of society. In this program 
the Committee on Educational Testing cooperates with other agencies of 
the American Council, such as the Cooperative Test Service, and with the 
Educational Records Bureau, which will be discussed later. It was ('xpected 
that as a minimal program the English, Intelligence, and General Culture 
sections of the Pennsylvania College Achievement Test, which the Caruegi<^ 
Foundation placed at the disposal of the Committee, would be used. The fol- 
lowing tests were available but not all were necessarily given in all the j)ar- 
ticipating colleges: 

1. Cooperative English Test, Series 1, Form 1933. A comprehensive 
English examination prepared by S. A. Leonard, V. A. C. Henmon, M. II. 
Willing, W. W. Cook, D. G. Paterson, and F. S. Beers, including sections 
on English usage (100 items, 65 minutes), spelling (55 items, 10 minutes), 
vocabulary (100 items, 20 minutes). Total, 255 items, 95 minutes. 

2. Cooperative Literary Aequaintance Test, Form 1933. A literary ac- 
quaintance and literary information test prepared by F. S. Beers and D. 
G. Paterson (200 items, 45 minutes). 

3. Cooperative General Culture Test, Form 1933. A cultural test, largely 
informational m character, prepared by E. F. Lindquist, H. R. Anderson, 
S. Timberg, J. Storck, and others, including three sections: history and 
social studies, 268 items, 80 minutes; foreign literature, 295 items, 55 min- 
utes; fine arts, 240 items, 45 minutes. Total, 803 items, 180 minutes. 

4. Cooperative General Science Test for College Classes, Form 1933. A 
brief general science test prepared by R. W. Tyler, H. W. Farwell, G. M. 
Kay, W. J. Eckert, S. R. Powers, F. L. Fitzpatrick, O. E. Underhill, V. 11. 
Noll, and A. W. Schindler; 270 items, 60 minutes. 

5. Cooperative General Mathematics Test for College Classes, Form 

1 Ediwakmal Record, Voi. 12, July, 1931, p. 3.16. 
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1933. A comprehensive test of high school mathematics, with brief sec- 
tions on college algebra, analytics, and calculus; prepared by H. T. Lund- 
holm and L. P. Siceloff; 166 items, 120 minutes. 

6. A Foreign Language Test' French, German, or Spanish (reading 80 
items, vocabulary 100 items, grammar 100 items) or Latin (vocabulary 
100 items, grammar 100 items, reading 137 items); total time for each 
language test, 90 minutes. 

7. Cooperative Contemporary Affairs Test, by Alvin C. Enrich, Elmo 
C. Wilson, and others. This test is based on an analysis of the content of 
current literature and is intended to measure the extent to which students 
keep abreast of significant current affairs in the fields of art, literature, 
government, international relations, politics, economics, religion, etc.; 207 
items, 90 minutes. 

8. Cooperative Physics Tests, by the Committee on Tests of the Amer- 
ican Association of Physics Teachers. Part I, Mechanics, 60 minutes; Part 

II, Heat, 30 minutes; Part III, Sound and Wave Motion, 20 minutes; 
Part IV, Light, 40 minutes. Part V, Electricity, 50 minutes; Part VI, 
Modern Physics, 25 minutes. The six units together constitute a general 
comprehensive test in college physics, but each college was advised to 
choose a combination of topics to suit local needs. 

9. Cooperative Chemistry Tests, by B. C. Hendricks, F. P. Fnitchey, 
A. G. Homey, R. W. Tyler, and others. Part I, Information and Terminol- 
ogy, 90 minutes; Part II, Interpretation of Experiments, 45 minutes; Part 

III, Application of Principles, 45 minutes; Part IV, Symbols, Formulae, 
and Equations, 75 minutes; C., a combined test covering three important 
aspects of elementary chemistry, Information, Terminology, and Applica- 
tion of Principles, 2 hours. 

10. Cooperative Zodlogy Tests, by W. M. Barrows, J. W. Price, L. H. 
Snyder, and others. Part I, Information and Terminology, 90 minutes; 
Part II, Interpretation of Experiments, 46 minutes; Part III, Application 
of Principles, 45 minutes; Part IV, Identification of Structures and Their 
Functions, 75 minutes; Part V, Laboratory Techniques: (1) Using the 
Microscope, (2) Making a Temporary Mount of Prog’s Skin, (3) Making a 
Fresh Mount of Striated Muscle, (4) Dissecting Muscles of a Frog’s Hind 
Leg, (5) Dissecting the Ventral Body Wall of a Frog, (6) Dissecting the 
Digestive Tract of a Frog, (7) Dissecting the Circulatory System of a Frog, 
(8) Dissecting the Brain of a Frog, (9) Dissecting the Earthworm; C., a 
combined test covering three important aspects of elementary zoology. 
Information, Terminology, and Application of Principles, 2 hours. 

11. Cooperative Botany Tests, by F. K. Butters, P. O. Johnson, R. B. 
Gordon, C. W. Horton, H. C. Sampson, L. 11. Tiffany, and others. Part I, 
Information and Terminology, 90 minutes; Part II, Interpretation of Ex- 
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periments, 45 minutes; Part III, Application of Principles, 4.5 minutes; 
Part IV, Identification of Structures and Their Functions, 75 minutes; 
Part V, Laboratory Techniques, Using the Microscope ; C., a combined test 
covering three important aspects of elementary botany. Information, 
Terminology, and Application of Principles, 2 hours. 

12. Cooperative Geology Tests, by G. Marshall Kay and others. Histor- 
ical Geology, 90 minutes; Physical Geology, 90 minutes. 

The detailed analysis of the results of the tests for each college is left to 
those most familiar with their own local situation, since the value of the re- 
sults rests on the way in which they are used by the individual institution in 
guiding each student effectively. On the basis of a tabulation of all the results 
on national sophomore percentile scales the national standing of each stu- 
dent can be determined. The most important result which has been revealed 
since the testing program has been used is the existence of an extraordinary 
degree of variability among the colleges themselves and among the students 
in each college on every test taken. Not only is there variability among lire 
students of one year but there has also been discovered considerable over- 
lapping among all the students of all the four years, and of students in inde- 
pendent or private secondary schools to whom similar tests have been given 
by the Educational Records Bureau. The variability and overlapping can 
only signify one thing, that the attempt to deal with all students at any level 
as a homogeneous group has been proved to be unwarranted. The results of 
the tests have made it possible to study the prevalence and degree of variabil- 
ity in a large number of items — on each of the tests of intelligence and achieve- 
ment — and to compare students studying for different degrees, general aca- 
demic and professional. 

In general the results of the tests conducted since 1932 tend to shake the 
traditional interpretation of equality of opportunity as identity of oppor- 
tunity. 

It is obvious that with such student bodies as here indicated, mass 
standards and “average performance” are not only irrelevant but ironical. 
It seems equally obvious that no simple and easy changes can be remotely 
adequate for making the readjustment demanded by the heterogeneity 
here exposed. Nothing short of a definite abandonment and repudiation of 
blanket prescriptions and unmitigated mass standards, and a genuine and 
wholehearted acceptance of the fact of individual differences and their in- 
creasingly obvious administrative and guidance implications, would seem 
to be a sufficient reason for hopefulness in regard to this crucial social 
problem.^ 

1 “The 1934 College Sophomore Testing Program,” JUdiioational Record, Vol. 15, October, 1934, p. 493. 
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The ideal of equality of opportunity has in education been responsible for 
pressure toward conformity, the development of uniform patterns more or 
less equalized and made identical on a quantitative basis, and insistence on 
common standards. The results of Ihe tests disprove completely the possi- 
bility of attaining such an ideal and, if anything, point to the danger of pro- 
ducing a dead level of mediocrity. But “mediocrity, as an ideal, is not demo- 
cratic. Mass instruction designed to level individual differences cannot show 
the schools what to do for the unusual or failing student.”' It is obvious that 
this conclusion does not and cannot mean the adoption of a dual system of 
education — one for the able and another for the dull. The significance of 
such studies as the College Sophomore Testing Program would be lost unless 
it were realized that the fundamental conclusion is that education must be 
individualized and adapted to the abilities of each student. 

Democratic ideals, far from aiming at a dead level of mediocrity, recog- 
nize and accept individual differences and would make use of them for 
socially acceptable ends. True education makes distinctions among men; 
it means finding one’s own level, but misguided theorists on democracy 
and democratic education often obscure this fundamental truth. It is the 
function of the Committee (on Educational Testing) to help make the 
philosophy of individual guidance practical and in so doing to support the 
widespread movement toward revaluing educational traditions.^ 

The Committee is at pains in each of its reports on the College Sophomore 
Testing Program to stress a number of points. First, the tests may in time 
be improved from the point of view of validity. Second, tests can be improved 
only through the cooperation of experts in measurement and psychology and 
expert teachers in the subjects to be tested. Third, the tests do not and can- 
not test the whole of education and of instruction. Fourth, the tests furnish 
a certain amount of information which is valuable for the purpose of guiding 
individual students, but for effective guidance such information must be con- 
tinuous and cumulative. Fifth, systematic records must be kept over a period 
of years and should include information not only of the land that can be se- 
cured by means of tests, but of a far wider range so as to cover a student’s 
peculiar character traits, his degree of initiative, his ability to carry out in- 
dependent, self-initiated study, his health and other personal circumstances 
that may have a bearing on his work. 

Reports from the colleges which have participated in the testing program 
indicate that many have already begun to use such systematic cumulative 

1 Ibid , p. 477. 

2 Ibid., p. 471. 
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records, some have embarked on programs of guidance and counseling, and 
others are beginning to make special provisions for students of different 
abilities. The ultimate aim of the testing program is to put into the hands of 
teachers and administrators of educational institutions information which 
■will enable them to provide “the right education for the right pupil” or to 
quote from one of the Reports on the College Sophomore Testing Program: 

Teaching, like the practice of medicine, is an art. The physician makes 
use of chemical analyses, fluoroscope examinations, and the like; the teacher 
uses achievement tests, personality ratings, and narrative accounts of 
school and work history. In the final analysis both teacher and physician 
prescribe or advise intelligently only in terms of the total clinical picture — 
not in terms of any single test or interview. ‘ 

Cooperative Test Service 

The development and progress of the College Sophomore 'rc.sting Pro- 
gram were made possible by the creation under the American Council on 
Education of the CoSperative Test Service. This Service arose out of the 
proposal of a Committee on Vocational Guidance appointed in 1923 by 1 he 
National Research Council to consider methods for securing information 
about individual students in order to discover their fitness for different voca- 
tions. This committee soon became the Central Committee on Personnel 
Procedures of the American Council on Education. After a number of con- 
ferences four sub-committees were appointed in 1927 as follows: Sub-Com- 
mittee on Personal Record Cards, Sub-Committee on Achievement Tests, 
Sub-Committee on Personality Measurement, and Sub-Committee on Occu- 
pational Information, to which another Sub-Committee on Personal De- 
velopment was added about a year later. The work of these sub-committees 
was placed under the supervision of a Central Committee of the Committee 
on Personnel Methods of the American Council on Education. In 1930 it was 
decided that a definite program for the preparation of achievement tests 
could be prepared and developed. To this end a grant of $500,000 was ob- 
tained from the General Education Board for the creation of a bureau, the 
Cooperative ff est Service, to prepare over a period of ten years a series of 
tests adequate in number, sound in construction, and of measurable validit'v 
and comparability. 

The essential feature of the Test Service is that it is cooperative. It enlists 
the cooperation of experts in universities throughout the country; it cooper- 
ates with schools and colleges throughout the country in administering the 
1 Ibid ; pp 4.76 f. 
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tests; it is subject to constant and continuous criticism wbich' makes ihe im- 
provement of the tests possible. Standardized tests have been available for 
years and in many but not all subjects in which objective examinations 
are desirable and needed, but these tests have been prepared by one or two 
individuals without adequate facilities for experimentation or critical evalua- 
tion. The Cooperative Test Service was established as a non-profit organiza- 
tion to produce a series of valid tests for a number of subjects of the high 
school and college curriculum in ten or twelve equivalent forms. In the words 
of the Director of the Cooperative Test Service, Professor Ben D. Wood, 
of Columbia University: 

The main purpose of this Cooperative Test Service is to supply the col- 
leges and schools of the country with measuring instruments which will 
yield accurate and comparable measurements of defined achievements.^ 

The desirability of having equivalent forms of tests in the same subject was 
emphasized in order to prevent coaching in the schools and the use of tests as 
teaching devices. The fear has, indeed, been expressed that the extension of 
the system of testing over a large area would exercise a constricting influence 
on the work of schools and colleges. Experience has not justified these fears, 
in the first place because “the tests in most of the subject matter fields are 
based largely upon certain fundamental common aspects of the subject mat- 
ters which are widely recognized as important elements of achievement in 
those fields, and therefore worthy of being measured.”^ One point that is 
reiterated by those who are most informed on the subject is that tests do not 
and cannot measure all the desirable aims of education, the more imponder- 
able aspects of achievement, for which subjective judgments must continue 
to be relied upon. 

All recognize the higher creative values of learning in English, foreign 
languages, and mathematics, and all recognize that the existing tests do 
not measure these values directly; but most schoolmen recognize that the 
aspects of achievement measured by the tests are positively correlated 
with the higher values, and an increasing number believe that their esti- 
mates of and control over the higher values are enhanced by the avail- 
ability of comparable measures of the more objective aspects of achieve- 
ment.® 

Secondly, the fear of the constrictive influence of tests is not justified if it 

^ “The Cooperative Test Seivice.” Edacatiojial Record, Vol. 13, July, 1B31, p 215. 

2 H, F. Hawkes, “Kepoit on the Cohpeiative Test Service.” Educational Record, Vol. 15, July, 193‘t, 
pp. 363 f. 

^ Ibid; p. 364. 
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is recognized that their purpose is to furnish sources of infornuition regard- 
ing the achievement and growth of individual pupils. They do not, like the 
traditional examinations, merely separate those who pass from those who 
fail; they seek also to discover both the range of abilities and deficiencies in 
order that both may be improved. As stated frequently by Dean Max 
McConn they constitute for the educator a scientific measuring tool compa- 
rable to the thermometer and stethoscope of the doctor. 

The scope of the work which has been set up for the Cooperative Test Serv- 
ice is indicated by the following analysis of the minimnm steps required for 
the production of five equivalent forms of a 200-question test : 

1. Survey field to be covered. 

2. Construct 2,000 questions. 

3. Edit these, eliminating about 400 questions by examination. 

4. Print eight 200-question lists as nearly balanced in subject matter and 
as nearly equivalent in difficulty as possible by inspection. 

5. Administer each of these lists to about 500 to 800 reprcfecnlaLivc stu- 
dents, giving them in pairs to the same students; for exauq)le, AB, 
AC, AD, AE, AF, AG, AH. 

6. Score these 4,000 or more preliminary question lists. 

7. Analyze the difficulty and validity of each of the 1,000 questions. 

8. Choose the 1,000 best questions. 

9. Divide the 1,000 best questions into five balanced and equivalent tests, 
Forms A, B, C, D, and £. 

10. Administer again in pairs to insure equivalence, to test reliability and 
validity, to correct and complete keys, and to secure adequate norms. ^ 

No better statement could be made than is implied by this analysis of the 
fact that examining is a major function apart from instruction. While the 
drafting of some ten questions in the traditional examination does not in- 
volve a great deal of time nor the marking require long conferences, experi- 
mentation and discussion, the major part of the time in the objective tests is 
taken up by the preparation and construction while the scoring is relatively 
mechanical. 

The advantages claimed for the series of comparable tests, such as those 
prepared by the Cooperative Test Service, are that (1) they make possible 
the measurement of individual growth year after year in certain types of 
achievement; (2) on the basis of the results educational guidance and re- 
search may be conducted since the tests exist in a large number of comparable 
forms related to each other; (3) an educational institution can maintain 
Cooperative Test Service,” Jmimal of Hvjher Education, Vol. II, May, 1931 , 
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standards of admission, placement, promotion, certification, and graduation 
which remain uniform from year to year; (4) by using the results of the tests 
as a common denominator the results of subjective and other local examina- 
lions can be made closely comparable.* The Cooperative Test Service pub- 
lishes norms for its tests as they become available, subject to revision from 
time to time as additional data are secured. Tests for high schools and col- 
leges have now been constructed, each in a number of equivalent forms, in 
English, foreign languages, mathematics, general science, botany, chemistry, 
physics, mechanics, heat, light, electricity, modern physics, geology, historical 
geology, physical geology, American history, medieval history, modem 
European history, English history, world history, economics, contemporary- 
affairs, and general culture.^ 

College Psychologicau Examination 

Psychological tests for college freshmen, first introduced under the auspices 
of the National Research Council and developed in 1924 with the financial 
support of the Commonwealth Fund, have been conducted for a number of 
years under the American Council on Education and after two years became 
self-supporting. The conduct of these tests by Professors L. L. Thurstone 
and Thelma G. Thurstone of the University of Chicago has in itself been a 
test of the tests, aimed to secure those which are best from the point of view 
of diagnosis and prediction The purpose of this annual test, now known as 
the American Council on Education Psychological Examination, is to secure 
not a single index of mentality but a profile chart which will show the special 
talents and deficiencies of each individual student and also make possible the 
derivation of a single composite index. On the basis of the results reports are 
prepared which give tables showing the norms of performance in each test, 
frequency of distribution, and gross scores. The test scores are correlated 
with academic grades of the students. In 1935 the American Council on Edu- 
cation Psychological Examination was given in 493 institutions to 189,506 
students, although the tabulations were made only of the records of 58,402 
students in 266 colleges. The following types of tests were used: completion, 
arithmetic, artificial language, analogies, and opposites.® 

^ The Cobperative Test Service, Announcement of Testst November, 1935. 

^ For descriptions of the methods of consh ucting tests in the social studies and the considerations that 
must be taken into account see E. F. Lindquist, “The Form of the American Histor7 Examination of 
the Cooperative Test Service,” Educational Record, Vol. 12, October, 1931, pp, 4*59 ff., and E. F. 
Lindquist, and H E. Anderson, “Achievement Tests in Social Studies,” Educational Record, Vol l-l, 
Apnl, 1933, pp. 3 ff. 

^ A Report on the Psychological Examination of each year is published m The Educational Record, The 
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Edxjcationali Becobds Bureau 

Private or independent schools in the United States have on the whole 
enjoyed greater freedom than in other countries. They are not governed as 
in the countries of Europe and elsewhere by official regulations with refer- 
ence to establishment, qualifications of teachers, and standards of instruc- 
tion, nor have they subjected themselves voluntarily as in England to the 
requirements and standards of external examining bodies except at one point. 
The exception has been the necessity of preparing their pupils for admission 
to colleges, since the majority of the independent schools are predominantly 
college preparatory schools and the majority of their j^upils do in practice 
plan to proceed to college. Hence, in so far as there is a common Lest it has 
consisted of the examinations either of the College Entrance Examination 
Board or of those colleges which have their own requirements for admission. 
During the last decade it has begun to be realized that these examinations, 
held at the close of a pupil’s secondary school career, come too late to make 
constructive educational guidance possible. This realization was accompa- 
nied by a desire for reliable and comparable measurements of the native 
capacities and scholastic achievements which with other available informa- 
tion could serve as a basis for continuous study and educational guidance of 
pupils. Admission to college and the ultimate choice of a career were con- 
sidered to be issues too critical to be subjected to the hazard of a single ex- 
amination. In 1927 a number of independent schools decided to organize the 
Educational Records Bureau to assist member schools to secure reliable and 
comparable measurements of the native capacities and academic achieve- 
ments of their pupils as a basis for continuing study over a period of years. 

The Educational Records Bureau was incorporated and chartered under 
the Board of Regents of the University of the State of New York as a non- 
profit maldng organization, with its headquarters in New York. The Bureau 
is supported by an annual membership fee from the schools of $15 and a 
charge based on service costs for each test supplied; the service charge may 
be reduced if member schools do not avail themselves of the full services 
offered by the Bureau. These services include scoring and reporting the re- 
sults of the tests; comparative reports giving the distribution of pupil scores 
and percentile norms on the tests for the following classffications : (a) nation- 
wide, (b) state and regional, (c) community and school according to size and 

latest, “The 193S Psychological E’camination,” appeared in The Educational Record, Vol. 18, April, 
1936, pp. 996 ff. Ill 1933 a supplementaiy test was piepared for grades 9 to 19 but has not achieved 
the popularity of the original test, probably because of the existence of other local systems for conduct- 
ing testing programs. 
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type, (d) sex, and (e) age; and confidential reports indicating the rank of the 
participating schools in the classifications mentioned ^ 

It was planned at first to give tests only at the end of the junior year of the 
secondary school or the eleventh year of a pupil’s scholastic career. After one 
year, when it was realized that still more information was needed than could 
be obtained from one series of tests, it was decided to institute examinations 
at the end of the tenth year. Finally, when the real purposes which such tests 
could serve were recognized, many of the schools adopted the practice of co- 
operating with the Educational Records Bureau in conducting tests for each 
pupil in each year of his career in school. The Bureau does not itself construct 
tests but employs tests prepared and supplied by the Cooperative Test Serv- 
ice, other organizations, and individuals. The Bureau’s functions are chiefly 
to score and report on the results of the tests and to coorrlinate these results 
on a comparable basis Some of the member schools undertake to score the 
tests themselves, but this practice defeats one purpose of the organization 
which is the establishment of significant norms representative of the whole 
group of schools, which now number 2G1. 

Although the derivation of representative norms is desirable, it has never 
been intended that the tests should be regarded as a sort of interscholastic 
competition. Nor in practice have the tests been used in this way, although 
comparisons with the norms may undoubtedly lead to serious investigation 
of such weaknesses as may be revealed in a school, — ^the curriculum, the 
methods of instruction, or the classification of pupils. The paramount pur- 
pose of the testing program of the Educational Records Bureau has been to 
supply reliable objective and comparable data on the basis of which the pupils 
may be studied as individuals and adjustments of school activities be made 
in accordance with their needs. The results of the tests are used for corrective 
and remedial work; they may be used to discover whether pupils are working 
in accordance with their abilities; they serve as measures both of achieve- 
ment and of educability. The tests differ from the traditional examinations 
in a number of respects; they are comparable from year to year; the results 
lend themselves to more detailed and realistic analysis of abilities and de- 
ficiencies ; they can accordingly be used to discover the actual needs of each 
pupil as an individual. While it may be claimed that external examining 
boards have always published reports on the strong and weak points revealed 
in the examinations in different subjects, such reports have been collective 
in character; they have been directed at all the candidates examined but 

^ See D. Segel, National and State Cooperative High School Tenthnj Progiains, p j U S. Office of 
Education, Bulletin^ 1933, Ko. 9 (Washington, D C , 1933) 
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■without ro'vealing uny particular details about each one j at best all I hal could 
be loiown about a candidate would be that he had passed or failed and the 
mark obtained, but so far as guidance for further educa(ion is concerned little 
or no help is supplied^ For the tests it is claimed that the results furnish a 
better understanding of each pupil as an individual and make possible closer 
adaptation of school procedure to his needs. 

To this end the Educational Records Bureau has enabled schools to supple- 
ment the original testing program, normally conducted at the end of the 
school year, with another series of tests, given at the beginning of the school 
year, to test scholastic aptitude or intelligence and for purposes of diagnosis 
and placement. The scholastic aptitude tests which have been used are the 
American Council Psychological Examination, Grades 9-12; the Pintner- 
Cunningham Primary Mental Test, Grade 1; the Otis Group Primary In- 
telligence Scale, Grades 2 and 3; the Otis Self- Administering Intermediate 
Examination, Grades 4-7 ; and the Otis Self-Administering Higher Examina- 
tion, Grade 8. The diagnostic tests include the Nelson-Donny Reading Test, 
Grades 9-12 ; the Iowa Silent Reading Test, Elementary Examina I ion, Grades 
5-8; and the Progressive Achievement Tests, Grades 1-12. 

It is not claimed, however, either that the tests have reached ultimate per- 
fection or that their results can tell the whole story about an individual 
pupil. One result of the testing program of the Educational Records Bureau 
has been to direct attention to the necessity of maintaining continuous 
records for each individual which should contain not only information about 
his ability as measured by intelligence tests, and achievements as measured 
by scholastic tests, but also records of teachers’ judgments and marks, and 
of his physical and personal development and social adjustment. Inevitably 
it has come to be recognized not merely that tests constitute a better examin- 
ing device but that they play an important part in a program of educational 
guidance. In other words the educational progress of an individual is not de- 
pendent merely on his intellectual or scholastic development but involves all 
those factors which go to make up the whole individual. Unlike the tradi- 
tional examination which reveals in the main what a pupil cannot do, the 
testing program seeks to discover what he can and should be encouraged to 
do, but this end can be achieved only by such continuous study of the pupil 
as is becoming increasingly possible by the use of cumulative record blanks. 

A long-standing grievance of college preparatory schools in the past has 

^ The same remarks would apply to reports sent to parents in such terms as “Could do better, if he 
tried, Does not work up to Ins ability,” “Does not concentrate sufSoiently,” or even “Is incoriigibly 
lazy.” See also p. 143. 
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been that the external examinations have tended to dominate the curriculum 
and instruction^ The same fear has been expressed with reference to a test- 
ing program, that the tests would in the long run tend to define or “freeze” 
the curriculum and prevent flexibility and adaptations to changing demands. 
Although the program of the Educational Records Bureau has been under 
way for less than ten years, there is sufficient evidence to prove that this fear 
is unwarranted. Far from limiting the curriculum or mechanizing the edu- 
cative process, the tests have served as instruments for a constant and critical 
evaluation of the curriculum; they have led to the elimination of parts that 
were unattainable and unprofitable; they have made its administration more 
flexible so far as the needs and abilities of each pupil are concerned. More than 
this, however, those most conversant with the purposes of the testing pro- 
gram have been the most assiduous in their insistence that the tests are not 
the whole of education, a point of view which may be contrasted with the 
place of the traditional examinations which too frequently occupied the cen- 
ter of attention. In other words, no more is claimed than can actually be con- 
tributed by the tests to a larger program of educational guidance.^ 


The Pennsylvania Study 

The value of the new type objective examination has nowhere been more 
successfully illustrated than in the use to which it has been put in the Study 
of the Relations of Secondary and Higher Education in Pennsylvania. The 
widespread extension of the use of the new type examination in order to se- 

1 As d result of protest against the contiol exercised over the work of secondary schools by college en- 
tiance requirements a small group of public and private second, ny schoots, under the Conumssion on 
the Relation of School and College of the Progicssive Education .Association, was set tree in 19SI to 
engage in experimental work on tlie understanding th.at a number of colleges will admit students fioiii 
these schools for a pel iod of five years, beginning in 19.SG, without further examination. It is interesting 
to note, however, that these schools, thirty in number, have lecognized the ncce.ssity of devising some 
methods foi appraising and cviiliiating their own work and the woik of then pupils and will, among 
othei items of mfoimation, .submit to the colleges students’ scoics on scholastic aptitude, aehievemenl, 
and other diagnostic tests given by the .schools duiing the second.u-y school coiuse, speeiahsts m tests 
and measui ements have been appointed to construct tests in accoulanoe with the objectives and content 
of the expel imental woik which has been undci taken. See W. A. Aihin, “The Purposes of the Eight 
Yeai Experimental Study,” Educational Bncoul, January, 1935, pp 107 ff.i and Bepnit of the Thinl 
Annual Conference of the Eight Year Study, 193.5. 

^ It may be of interest to note the wider scope of a testing progiam such as that coiiduclcd by the Edu- 
cational Records Bmcaii. In 1929 a comparative study of English schools was made by the Bureau 
using intelligence tests and achievement tests in English, Pi each, ,ind algebi a See Educational Records 
Bulletin, No. 5, Apiil, 1930. Te-,tiny Sihonl Achierement in Enyland and Aintriui. Report of the Re- 
sults of Intelligence and Arhiecement Tests giren in Foui English Schools Compared with Reiords on 
Stmilai Tests of Students in Amei lean Independent Secnntlnry Schools, May, 1929. Preference may be 
made to olhei mtei national comparative studies of aeliievement S. R. Powers, “Chemistry in English 
and Ameiican Schools,” School Science Review, Vol. VIII, June, 1927, pp. 35S ff , and a “Compaiison 
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cure continuous informaLion about pupils and sliulcnls lias been indieaLcd in 
the preceding sections, but, while the need of such inforinalion for purposes 
of educational guidance has been recognized and adiuiLled generally, its ac- 
cumulation has rarely been continuous aiul in I he hands of a single authority. 
The Pennsylvania Study derives its significance from the fact that contin- 
uous records of ability and achievements have been secured and maintained 
by the same body for a large group of students from their enlranee into high 
school until their graduation from college, that is, over a period of eight years. 

This is not, however, the only significant aspect of the Study, nor, impor- 
tant as it is, is the proof of the great degree of variability among students and 
the educational institutions which they attend and which undertake lo treat 
them all very much in the same way. Apart from the major contribution of 
the Study as an illustration of the ways in which the new type examinations 
may be used, the importance of the Study rightly inlerjireled will lie in the 
attack which it has made on the characteri.ytically American organizaliou of 
education in terms of time spent in an educational inslitulion or on a course, 
that is, the system of measuring education in terms of uuil s, juiiul s or eredils. 
Stated in another way, the Study has revealed the ('act that I he sy.slem of 
credits militates against the intellectual growth of studeuls and I he aecnmu- 
lation of enduring knowledge. 

The Study arose out of discussions of the relations bet ween liigh schools and 
colleges which had been conducted in 1925 and 192G by Lhe Association of 
College Presidents of Pennsylvania. A Commission, representing the Associa- 
tion and the State Department of Public Instruction of Pennsylvania, in- 
vited the Carnegie Foundation for the Advancement of Teaching to under- 
take an investigation of the problems involved in the relations of high schools 
and colleges. Interest in these problems had already been manifested in a 
study prepared by Dr. William S. Learned, staff member of the Carnegie 
Foundation, and published under the title of The Quality oj the Educational 
Process in the United States and Europe.^ The main thesis of this report was 
that the difference in the quality of education in England, Germany, and 
France as contrasted with Lhe United States is due to the recognition of dis- 
tinct aims, continuity of courses, and responsibility on the part of the students 

of Content and AccompUshment of Students in English and Ameiican Secondaiy Schools,” JowrnaJ of 
Chemical B ducat ion ^ Vol. IV, December, 1927, pp. 1505 If., G. MacGiegor, AOuevement Te^ts %)i the 
Trimmy School A Com^taiative Study with Ameiican Testitn Fife [London, loci'!-). Similai conipaia- 
tive studies have been made in British Columbia and Austiaha The question may well be raised 
whether such comparisons could have been instituted with any degiee of leliabihty if the liaditional 
form of examinations had been used 

^ Carnegie Foundation for the Advancement of Teaching. Bulletin Twenty (New York, 1927). 

Phis impoitant Bulletin is unfoi tunately now out of punt. 
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for the accumulation of acc[uired knowledge. While secondary and higher edu- 
cation in the European countries is dominated by a systematic effort to secure 
and promote continuity of intellectual growth along a number of distinctive 
lines, the program of students m corresponding institutions in the United 
States is made up of a number of unrelated, discrete parcels of knowledge or 
courses, each one on its completion receiving the sanction of a certain number 
of credits, which when piled up to the reijuired amount lead to graduation 
whether from the secondary school or the college. At no stage, unless it be in 
a college entrance examination, is the student held to an accounting of the 
whole sweep of education that he has received up to that point. 

The Carnegie Foundation agreed, with the cooperation of the colleges, 
the public high schools, and the State Department of Public Instruction of 
Pennsylvania, to undertake a study of the relations of the secondary schools 
and colleges over a period of seven years. Dr. William S Learned was in 
charge of the investigation and associated with himself Professor Ben D. 
Wood of Columbia University as the e.xpert in the technical field of tests and 
measurements. The plan of the inquiry was to subject the educational pro- 
cedure of secondary schools and colleges as a unit to examination at three 
points; (1) at the time of entrance to the secondary school, (2) at the close of 
the secondary school course, and (3) toward the close of the college course. 
The Study, in other words, was intended to secure as much information about 
the scholastic and other progress of students from the last years of the ele- 
mentary schools, through the secondary schools, and in the colleges up to the 
time of graduation. It would thus follow the progress of students through 
their educational careers and close with an assessment of the final product 
or “an inventory of the baccalaureate mind In this way it was hoped to 
discover as much information as possible about a whole school and college 
generation, and to answer some of the following questions : What sort of mind 
goes to colleges, teachers colleges, business, industry, etc.? How many stu- 
dents with marked aptitude for intellectual pursuits are unable to go to 
college for economic or other reasons, and what proportion actually enters 
college without evident qualifications? What sort of mind goes to college, 
continues, and grows in knowledge and power? 

Two important instruments have been used in the conduct of the Penn- 
sylvania Study, intelligence and new type tests and the cumulative record 
card on the basis of which students could be placed more accurately and ad- 

^ This p^an may be compared with the prospective and letrospective studies undertaken by the Scot- 
tish Council for Reseaich in Education and published in two volumes (1) The hiUlhgence of Scottish 
Children A National Survey of an Age-Group (London, 1933); and (9) The Prognostic Value of Uni- 
versity Entrance Examinationis in Scotland (London, 1936). 
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vised to the best advantage. Thus several thousands of pupils in the seventh 
year of their educational careers were tested for mental, social, ami physical 
traits in order to obtain and record a comprehensive and trustworthy story 
of their achievement. The subsequent career of each of these pupils was fol- 
lowed on a cumulative record card which aimed to bring together informa- 
tion desired and to test experimentally the value of such record in all intel- 
lectual education. Through achievement testing and personal scrutiny the 
intellectual characteristics of the group of pupils concerned were unusually 
well understood. Three results followed from this part of the Study. The first 
was an emphasis on the importance of competent guidance of pupils on the 
basis of all of the information obtained about them. The second was the rev- 
elation of the inadequacy of a system of education based on credits and 
points instead of the provision of opportunities for a continuous program of 
education in accordance with the abilities and interests of a pupil. The third 
result was the corollary of the second, that the educational program of each 
pupil should be sequential and continuous instead of a collection of separate 
and discrete units, and should emphasize cumulative achievement lo be 
measured, whenever the need might arise, by objective tests of a comprehen- 
sive character. 

From the results obtained information was made available on the persist- 
ence of certain abilities, the development of new interests, and the effect on 
ultimate achievement of different types of curricula and school organization. 
Such information, it was found, would have the further effect of simplifying 
the relations of secondary schools and colleges, since the colleges would receive 
more continuous and comprehensive information about candidates for ad- 
mission than has been available in the school certificates or than could be 
secured by a single entrance examination. Thus it was found in 1932 in 
following up the records of students who had entered college only to with- 
draw during the first year that the causes of what were apparently cases of 
maladjustment were the results of discrepancies between marks obtained in 
high school and scores obtained in objective tests, and ignorance of the 
ability, defined achievements, and effective interests of the individuals con- 
cerned. 

When the investigation was carried into the colleges the same defects were 
discovered as in the high school : the inadequacy or non-existence of guidance 
and advisory systems, the maladjustment of students, the lack of flexibility 
due to an emphasis on credits instead of a program of continuous education. 
A large number of the students who had been tested in the last year of their 
high school course were again tested in the forty or more colleges in which 
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they were distributed at the end of their sophomore year. The purpose under- 
lying the test was to discover what the bachelor’s degree amounts to “in 
terms, first, of clear, available, important ideas, and, second, of ability to 
discriminate exactly among ideas and to use them accurately in thinking,” 
objects which “arc among the mam reasons for acquiring an education and 
for the existence of educational institutions.” An intelligence test was added 
in the sophomore examination. The tests included: (1) An intelligence test. 
(2) A “general culture” test, “ranging from very simple to very difficult ques- 
tions, over the following fields: general science, 292 questions; foreign liter- 
ature, 333; fine arts, 251; and general history and social studies, 346,” — a 
total of 1,222 questions. The questions were not based on the content of 
organized college courses but were intended to be “a fair measure of the 
permanent increment, the effective accumulations, attributable to a stu- 
dent’s desire really to assimilate the itleas that constitute an academic educa- 
tion as contrasted with the urge merely to possess a degree as the result of 
having secured credits in a sufficient number of semester courses.” (3) Two 
tests in subjects ordinarily included in formal college courses: English, 450 
questions; mathematics, 210. Six of the forty colleges administered this test 
to students in all the four college classes.^ 

It is unnecessary here to discuss the results of this test in detail. Tor pur- 
poses of the present discussion the significance of the test lies in its use as a 
method of assessing the growth of students. Comparable data which were 
made available in those colleges in which all the students took the test re- 
vealed the fact that in certain colleges there was no substantial difference be- 
tween the four contemporary college classes in command of “enduring Imowl- 
edge.” Students can apparently obtain their degrees if they can accumulate 
a sufficient number of credits on the basis of examinations passed at the end 
of each semester course; the test revealed no evidence of a requirement that 
a student digest or retain Icnowledge which he could have acquired either in 
his courses or from other sources of education. 

The same tests were given to these same students when they completed 
their senior year in 1932 and to high school seniors in 1933 and 1934. It was 
found that 85 per cent of the college students gained in varying amounts dur- 
ing their last two years in college. Details regarding these gains have not yet 
been published. But the most conspicuous fact revealed was variability, be- 
tween institutions, among students taking the same courses in each institu- 
tion, and in each institution among students talcing different courses’ such as 
arts, science, business, education, and engineering. Further, there was a con- 
1 Carnegie Foundation for the Advancement of Teaching, Tio&ntif-ftfiK Annual Report^ pp, 51 if* 
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siderable amount of overlapping among the high school seniors, college sopli- 
omores, and college seniors so that a percentage of college seniors were found 
to rank lower than a percentage of high school seniors. A system sucli as this, 
it was concluded, is defective in a large number of ways but pritnanly in at- 
tempting to deal with bodies of students as homogeneous when in fact they 
are highly heterogeneous, and, on the specious plea for equality, undertaking 
to provide for them varieties of courses and curricula which are assumed to 
be equivalent. As pointed out by Dr. Learned, 

The net reaction of these penetrating solvents of old conditions has been 
to make a solemn emphasis on any particular external curriculum, as a 
means of educational salvation, seem futile and irielevant. The important 
question m an individual’s education has shifted entirely. Instead of ask- 
ing solely, “Have you at some time learned this or that?” specified by the 
institution as of old, the question which it now seems most profitable to 
hold before each student is “What do you know?” — meaning by that 
“What knowledge, skills, and appreciations from the many source.s avail- 
able to you, have you, by virtue of your own evolving interests and abil- 
ities, gathered, organized, and matured within you to the point of eflective 
mastery and use? You arc an artist; your materials are all cdiout you; what 
sort of educated man do you have in mind to seek to become?”' 

To put such an ideal before the student means not the prescription of a 
certain number of courses to be completed within a particular period of time; 
it involves on the part of those who are to guide and advise him a thorough 
knowledge of the goals attainable by him so that he may be placed in the way 
of his own self-education. But the progress of such self-education unless it is 
to be in a void must be subject to measurement, appraisal, and record, and 
for this purpose the instruments have now been developed. The existence of 
individual differences and of variability has been known for a long time, but 
little has been done to formulate types of educational program which would 
challenge the abilities of each to their fullest limits. What Dr. Learned calls 
the economics of self-education point to the same conclusion i 

To invite or to compel every child to climb a uniform educational ladder 
to the bachelor s degree, even though doing so means moving the ladder 
downwaid while the student remains stationary, swells the expenditure in 
an inverted relation to the results, and achieves results that have little 
inner meaning when secured. 

Rather let us start with a truthful and significant tested inventory, in 
terms of known standards, of what each child, when offered every reason- 

Foundation for the Advancement of Teaclung, Tim tieth Annual Report, p. 60 (New York, 
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able aid and opportunity, progressively becomes through those powers of 
imagination and self-education that alone are potent. Such inventories, 
kept constantly open to correction, shortly project in the main both the 
quantitative and the qualitative aspects of the later educational problem 
for which the community should prepare.^ 

The adoption of such measures for the distribution of education is ju.stificd 
further by social policy which demands not only a body of trained leaders 
but also a body of citizens appreciative of and able to understand “the true 
expert in ideas.” 

The testing program of the Penn.sylvaina Study has been criticized, as 
have other similar programs which have employed the new type, objective 
tests, on the ground that they test “mere knowledge” and fail to measure 
the power of organization and orderly e.xpression, reasoning power, literary 
or aesthetic appreciation, or the other “higher processes,” all of which, it is 
admitted, constitute the essential marks of a liberal education. The answer of 
those who have conducted the examinations is that “experience shows that 
the higher processes are directly conditioned by the comprehensiveness of im- 
portant knowledge and by the clearness with which the ideas or the elements 
in such processes are held.” Knowledge, in other words, is essential to think- 
ing, despite the claims of those who minimize the value of knowledge on the 
professed ground that the purpose of education is to teach pupils “not what 
to think but how to think,” or “to develop their power of reasoning.” 

Some were inclined to dismiss any test requiring a “yes” or “no” answer 
to disconnected statements, or even a choice among several opposites, as a 
test of “mere” knowledge without apparently realizing that knowledge is 
the necessary basis of all thought, and that if it be accurate and compre- 
hensive there is at least strong reason to believe that the power to think 
must also be accurate and substantial in order to acquire and maintain it. 
The student who, from an adequate knowledge, can deal successfully with 
a hundred statements like the following: “The problem of capital versus 
labor had no place in the guild system of early modern Limes,” must appar- 
ently be granted the power to think in that field from which the statements 
are drawn.“ 

The criticism has been met in another form by Dean Max McConn . 

It comes to this : a high score in this kind of test does not infallibly dem- 
onstrate the attainment of what we call a liberal education; but a low 
score does infallibly demonstrate a lack of liberal education, because it re- 

^ Ihid.^ p. TO. 

- Carnegie Foundation for the Advancement of Teaching, Twenty-fifth Annual Report, p. 53. 
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veals the absence of the foundation upon which a liberal education must 
stand. Let me vary the figure. One may have a flourishing tree without 
fruit, but one cannot have fruit without a tree; knowledge — ample and 
accurate loiowledge — is the tree on which the fruit we call erdture must 
grow.’^ 

Of the many striking conclusions and implications of the Pennsylvania 
Study, not the least significant of which is the fundamental criticism of the 
discontinuity of the educational process resulting in American high schools 
and colleges from the artificial system of units and credits, the following are 
the most pertinent to the present discussion: (1) Learning students is a pre- 
requisite to teaching them, or, to use a phrase which is now frequently used, 
education must be individualized. (2) Education must be regarded as a con- 
tinuous process and must be based upon all kinds of information that can be 
cumulatively recorded about a student. (3) The abilities and capacities of 
students must be identified as early as possible and more adequate provision 
must be made for differentiated treatment of students in the assignmcnl of 
programs of study. And (4) an integrated education demands early identifi- 
cation of needs, closer cobperation among teachers at different levels of edu- 
cation, and more coordinated procedures, all of which can be made effective 
through the use of cumulative record cards which follow a student through 
his educational career.^ 

Cumulative Records and Educational Guidance 
To conclude that the movement which has been described up to this point 
is merely a movement to substitute the new type or objective tests for the 
traditional form of examinations would be to place a wrong interpretation on 
it. Those who can speak with authority insist that the new type tests can 
measure only one but a very important aspect of the total process of educa- 
tion; they are equally insistent that other forms of examination — the oral 

' Max McConn, “How Much Do College Students Learn?,” North Amei loan Review, Novembei, 1931, 
p. 451. 

^ On the Pennsylvania Study see Cainegie Foundation for the Advancement of Teaching, Program, for 
a Study of the Relation of Secondat y and Higher Education in Pennsylvania, Progi ess Reports, I-I Vi 
and Annual Reports, Twenty-fifth, pp. 51 ff.; TweiAy-snth, pp. 31 ff.; Twenty-seventh, pp 65 If.; 
Twenty-eighth, pp. 39 ff.; and Thirtieth, pp, 47 ff. See also the iollowing articles: W. S. Learned, 
“ 'Credits’ versus Education'' m Pi oeeedings of the Associated .Academic Principals of the Slate of New 
York, 1933, and “Testing for Values in Education” in Bulletin of the Association of American Colleges, 
Vol. XX, No 1, Mardi, 1934; and Max McConn, “The Carnegie Foundation’s Study of Secondary 
and Higher Education in Pennsylvania,” in Bulletin of the American Association of Collegiate Regis- 
trais, Vol. 5, No. 9, and “How Much Do College Students Learn!*,” in Not th American Review, Novem- 
ber, 1931, pp, 416 ff. 
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and the essay types — also have their place. What is claimed for the tests is 
that they offer a more accurate, more objective, more reliable and comparable 
measure of a student’s command of the field of study than can be obtained 
by the traditional examination alone. Running through all the investigations 
which have been discussed is the implicit recognition that objective measures 
do not have the deterministic and predictive value that was at one time 
claimed by some of their too enthusiastic advocates. It is accordingly ad- 
mitted that the use of one test alone or even of a number of tests at the same 
time have little greater value in contributing to the knowledge about an in- 
dividual than the traditional examination. The development of and progress 
in the use of objective tests, if correctly interpreted, point to a new concept 
of education, that it is the responsibility of educators to discover the kind 
of education from which an individual may be expected to profit — to provide, 
in other words, the right education for the right pupil under the right teacher. 
This means not merely an appraisal of a pupil’s intellectual status as meas- 
ured by an examination, but the collection of as complete information as pos- 
sible about the intellectual, personal, and social characteristics of an indi- 
vidual both in and out of school. If the central function of educational ad- 
ministration is the guidance of the individual to that land of education which 
is most appropriate and adequate to his needs, interests, and abilities, such 
information must be both comprehensive and continuous. What is clear 
from the use of tests is that there is no single measure for predicting educa- 
tional success. 


Cumulative Record Cards 

One of the most important outcomes of the testing movement has been 
the advocacy of the cumulative record card. Wherever efforts were inaugu- 
rated to discover information about the ability of pupils by means of tests 
given at a single time, as for example, in the last year of the high school 
course, it was found that the tests must be pushed back earlier until it is 
proposed to administer such tests throughout a pupil’s educational career. 
As information derived from tests was accumulated, it was equally recog- 
nized that still more must be known about the health and physical condition, 
the social and economic background, the character and everything that goes 
to make up an individual’s personality. Such information to be of value must 
be secured over a period of years and recorded on a blank which lends itself 
to easy interpretation. 

The movement for the introduction and use of cumulative record cards 
was stimulated by a Conference on Vocational Guidance in Colleges called 
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in 1925 by the Division of Anthropology of the National Research Council, 
and was taken up by the Anaerican Council on Education. As a result of a 
conference convened by the Council in 1927 a Sub-Committee on Personal 
Record Cards was appointed; Secondary School and College Cumulative 
Record Forms, drafted for the Sub-Committee by Professor Ben D. Wood, 
were published a year later and have since served as a model for similar cards 
at the elementary school, high school, and college levels. The model record 
card was based on the following criteria: 

1. The record form must show trends of development of abilities and in- 
terests. 

2. It must be based on acenrate measures and concrete observations. 

3. The record must provide a means for recording measures and observa- 
tions in comparable and meaningful terms, wherever such measures 
are available, but must at the same time provide for convenient record- 
ing and clear differentiation of whatever measures, subjective and non- 
comparable, may be available. 

4. The data should appear in a form and order capable of showing their 
inter-relations, and thus presenting a coherent and integrated picture 
of the individual. 

5. The record should be capable of quick reading; hence it should be in 
graphic form in so far as possible. 

6. The record should be fairly complete for the large mass of “normal” 
children, requiring auxiliary cards only for extremely atypical sub- 
jects, mentally or physically. 

7. The record should be reproducible, inexpensively, accurately and 
quickly, such as by photostating. 

8. The record should be accompanied by a carefully written and amply 
illustrated manual of directions. 

9. It should be administratively convenient, showing all available infor- 
mation on one continuous record form and permitting the collection 
of further data, by auxiliary cards and otherwise, for current use (in 
connection with the previous record) and for periodic sifting and enter- 
ing on the permanent record. 

10. Since all officers of the school that have to deal with students should 
have access to all the information that is available on each student 
anywhere in the school, it follows that the principal’s record and the 
teacher’s record should be duplicates so far as information of perma- 
nent significance is concerned.^ 

The Secondary School Cumulative Record Form provides for the record- 
ing of information on the following items: Name, religion, sex, date of birth; 
^ From "Peisonnel Methods," Eclucatiowil Mecoi d. Supplement, July, 1938, p. It. 
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mental age, chronological age; intelligence quotients, school grade achieved; 
school grade attended; educational quotients; achievement test and school 
marks; height and weight; photograph; schools attended; record of attend- 
ances and absences; causes of absence, discipline; unusual accomplishments; 
mental, emotional, and physical experiences; extra-curricular experiences, 
athletic and non-athletic; clubs and offices; vocational experiences; educa- 
tional plans; educational recommendations; vocational and professional pref- 
erences; interests reported; special defects; health; mental hygiene; social 
adjustments and home conditions; personality ratings; and measurements. 
Information on these items is recorded for each calendar year in such a way 
that the progress of the pupil can be traced easily across the record form. 

Educational Guidance 

The value of such information when recorded m full detail and contin- 
uously over a period of years lies m the use to which it can be put for pur- 
poses of educational guidance. As contrasted with the snapshot or spasmodic 
information which may be derived from a single examination or test, the 
cumulative record form presents a moving-picture of the individual to be 
advised. The purpose of educational guidance is, at the risk of repetition, to 
discover the needs, interests, and abilities of a pupil or student and to provide 
for him that education from which he is most capable of profiting, an aim 
which is desirable as much from the point of view of the individual concerned 
as from that of the society in which he is a member. Educational guidance is 
based on the theory that it is harmful to force pupils to follow courses for 
which they do not have the necessary ability, a practice which may result 
in despair, a feeling of inferiority, habits of dependence, a smattering of 
knowledge, and superficial learning. 

On the positive side educational guidance points to the need of greater 
flexibility and more differentiation of curricula and courses; it does not mean 
adaptation of education to the whims and caprices of the pupil, but an adap- 
tation based on a Itnowledge, as accurate as present techniques may discover, 
of what a pupil can do.^ 

The fundamental consideration which is involved here is whether a pupil 
shall be foredoomed to failure or whether, with such information as may be 
made available, he should be guided to make the most of his interests and 

1 The advantage of having available accniate, comprehensive, and coiiUniious records m consultations 
with parents, who according to the headmaster of an English Public School are more difficult to handle 
than pupils or teachers, is not to be lightly set aside Such records may be more successful lhan general- 
ized statements in making parents see their offspring as otheis see them. 
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capacities.^ There is still another consideration whether pupils shall be co- 
erced to work under pressure of imminent examination or whether they shall 
be put in the way of becoming educated in a normal, unforced, and significant 
way by the provision of a curriculum appropriate to their needs and abilities. 
If the latter, then cumulative, comprehensive, and continuous information 
about each pupil as an individual is urgently to be desired, information which 
reveals his intellectual strength and weakness, his physical power or handi- 
caps, his emotional qualities, and his personality as a whole. Educational 
guidance in accordance with this theory has now been made possible by the 
development of achievement and aptitude tests and the use of cumulative 
record cards. The latter have been compared by Dean Max McConn with 
the medical history and hospital chart, the former with blood counts and 
bacteriological tests. And just as no doctor will be satisfied with a diagnosis 
on the basis of a single test, so the educator, who is to guide and advise, must 
have available as comprehensive information as possible about a pupil. 

The fear has been expressed that to adapt the curriculum to the revealed 
powers of the pupil would result in lowering of standards. On the contrary, 
it may be argued that the attempt to submit all pupils to the same curriculum 
has certainly had that effect in the United States.^ To adapt the curriculum 
to the abilities and aptitudes of pupils will in fact make possible the attain- 
ment of higher standards in each field of work.® What is sought in the United 
States is a way out of the impasse created by the constantly increasing en- 
rollments in secondary schools and colleges. The American ideal of equality 
of opportunity, it has at last been discovered, cannot be realized in terms of 
mass education but rather by the individualization of education. Nor do 
marks obtained in courses provide an adequate basis for the differentiation 
of education which is implied, although such subjective judgments have their 
place. The situation is well summarized in a statement by Professor Edgar 
W. Knight of the University of North Carolina : 

In time we may have to discontinue the present emphasis upon marks 

1 In contrast to tins may be cited an example from an English secondary .school in which the teacher 
infoimed a whole class at the beginning of the year that he had neFer known a pupil in that class to 
pass the external examination for which they were ostensibly to be prepaied. Similaily in Fi'ench 
secondary schools the complaint is frequently heaid that there are too many non-valeurs. And yet such 
pupils, foredoomed to failure because of the rigidity of the curriculum, will m a few years be expected 
to assume the responsibilities of citizens alongside of those who will have “passed ” 

^ See I. L. Kandel, The Dilernfiia of Hemocracy (Cambridge, Mass., 1933), and John L. Tildsley, The 
Mounting Waste of the Ameuaan Secondary School (Cambiidge, Mass,, 1936). 

® Many years ago it was feared that the abolition of Latin and Greek as compulsory requirements at 
Edinburgh University would lead to a decline of classical learning Actually it was found that the 
standards were raised because the classical course was taken by those who had a genuine interest and 
aptitude for it. 
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that are now given at the end of each course and that count for almost any- 
thing, and state requirements in different terms. As means of measuring 
the completion of requirements for the first two years [of college], the ex- 
aminations must be intelligently designed. They may include any kind of 
tests, investigations, problems, or creative work by which the abilities 
and the performances of the students may be measured Provision should 
also be made for a periodic, perhaps monthly, report by the instructor of 
each of his students, a statement setting forth his observations of the stu- 
dent’s habits, health, character, personality, and any traits or qualities, 
which in the opinion of the instructor may influence the effectiveness of the 
student’s work. By these means a student’s past achievements and present 
interests can be measured more nearly and accurately and his future needs 
can be more nearly determined than at present.^ 

It is interesting to note that the International Commission of the New 
Education Fellowship considers the cumulative record card as “the way out” 
of the examination tangle.^ Among the few examples of schools or school 
systems which have adopted such cards is the Education Committee of Kent, 
England, which has introduced the Pupil’s Record Card in its elementary 
schools. Among the uses for which it has been designed the Record Card is 

(1) to serve as an indication of the level of work to be expected from a pupil; 

(2) as a first step in diagnosis ; (3) for the information of new teachers in cases 
of change of class or school; (4) for changes in class and school organization. 
This analysis concludes with the statement that 

The utility of the Record Card will be greatly extended when it is possi- 
ble to make more use of it in deciding the course of post-primary educa- 
tion most suited to a child’s needs. It seems reasonable to suppose that, 
ultimately, a scientific, objective, and normative record of a child’s school 
career extending over many years will come to be recognized as a safer 
guide in this than a one day examination, however skilfully conducted. 
The data on the Record Card (particularly the I.Q. and E.R.) should be 
quoted on behalf of pupils who are candidates for Special Places in Second- 
ary Schools or when the transfer of a child from a Central to a Secondary, 
Technical or Art School is being recommended. Finally, the Record Card 
does not cease to be of use at the end of a child’s school career or even after 
he has left school. It gives information valuable to the person who seeks 
to place the child in the employment most suited to his capacities, whether 
this person be the Head Teacher or the Vocational Guidance Officer.^ 

1 E, W Knight, High School Journal, November, 1931, pp. 937 f. 

^ The Emmimtion Tangle and the Way Out, Part III (London, 1935), 

3 Kent Education Committee, Notes un the Record Card, p. 3 (Maidstone, 193-1). See also Education 
in Kent, 1938-1933, pp. 49 ff. (Maidstone, 1931). 
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It is impossible to say how widespread is the use of the cumulative record 
card, whether in the forms issued by the American Council of Education or 
in other forms d The use of such cards has been strongly urged on and widely 
adopted by the independent schools associated with the Educational Records 
Bureau. They were employed effectively in the Pennsylvania Study. Two 
examples may be cited to indicate both the type of information gathered and 
the use to which it may be put. 

The Case of Margaret Elinor Crawford.^ The record covers the school life 
of this child from the age of eleven to seventeen (line 4)* beginning in the 
second half of the sixth grade (line 3) which she entered in February (line 5) , 
1935 (line 3), at the Howard Elementary School (line 36). 

The grades given by Margaret’s teachers in earlier years are summarized 
on the left of the score frame. Her spcllmg is rated A, music and drawing, 
C, and all other subjects B (cols. 1-3). A glance at her record as a whole 
shows that her teachers consider her a remarkably able pupil Except for 
a C in writing at the end of the second semester, 1935 (col. 4), there are no 
grades below B during the entire six years and A ratings are frequent. Her 
standard test scores are heavily concentrated in the highest part of the 
card and in general run higher than the teacher’s grades. There is none 
below the 83rd percentile; eight only are below the 93rd percentile, and 
thirty-seven are above the 98th percentile. This means that in the latter 
subjects, more than 98% of the children of like age talcing these tests 
scored below Margaret. 

Details of the standard test scores are to be found on the reverse side of 
the card. For the sake of clarity these are much abbreviated on the chart. 
In May, 1935, 1936, and 1928, and in March of 1937, Margaret tested 
consistently in the 99th percentile in intelligence. The other tests of these 
years consisted of the Stanford Achievement tests — a group of ten tests in 
various subjects each having a separate score in addition to the score for 
the group. The latter is recorded as the “Stanford Achievement” score 
(“St. Ach.”). In Margaret’s case the sections of the test spread slightly 
downward after the first year due to the increasing selection of the group 
on which the test is standardized and possibly also to the fact that the 
pupil is not doing her best because of constant association with inferior 
pupils. Since 1935 she has been ready for 10th grade work although com- 
pelled to sit through the 7th, 8th, and 9th grades and to work at their 

*Note: The lines of the Record are numbered on the estieme left and the columns in hne 5 

1 The^imei'ican Council’s form has been adapted for use m elementaiy schools. See Margaret W. Moore, 
Cumulative Educational Record for Elementary Schools, prepaied for the Cooperative Test Service 
(Washington, D C , n.d ). 

2 The Carnegie Foundation for the Advancement of Teaching, Study of the Relations of Secondaiy and 
Htgiher Education in Pennsylvania, Progress Report IV, pp. 3 ff. 
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pace. Tests in new material in May, 1928, (col. 16) — Cross English, test, 
Brown-Woody Civics, Junior Latin and C.R.B. Algebra — place her in the 
98th and 99th percentiles. These percentiles are based only on the local 
groups and are therefore indicated by crossed open circles © . 

In the senior high school Margaret tests about equally vrell in all types 
of work. She took general science throughout the junior and senior years, 
and in May, 1929, took a special test prepared for college freshmen and 
scored in the 91st percentile. Her interest in science led her to do a large 
amount of supplementary reading that summer, and when she returned in 
October she repeated the test and raised her score to the 98th percenlile 
(col. 22). This score she raised still higher in May, 1930 (col. 24). There- 
after she dropped science, but a year later, in 1931, she could still test to 
the 94th percentile in that subject (col. 28). 

Latin was begun in the fall of 1927 and the Junior Latin test the follow- 
ing May showed Margaret at the head of the local group (col 16), although 
the teacher gave her an A — ■ . I'hat this local score was a real achievement 
is shown by the standardized tests of 1929, 1930, and 1931 — in all of which 
she gamed the 99th percentile (cols. 19, 20, 24, and 28) . In her junior year 
her Latin teaeher suggested that she begin French by herself and gave her 
some preliminary lessons on the pronunciation. Margaret worked on gram- 
mar and easy reading during that summer and in the fall took the Colum- 
bia Research Bureau French test, scoring in the 83rd percentile. On the 
strength of this performance she entered second-year French and repeated 
the test twice during the school year, each time with noticeable improve- 
ment (cols. 26, 27, and 28). 

It should be noted that in the latter part of the senior year Margaret had 
the opportunity in every field of her secondary study to demonstrate her 
attainment by means of comprehensive objective examinations. Through 
constant use as a part of her education these tests had become a matter of 
routine to her and had given her the attitude that knowledge once ac- 
quired was to be retained and deliberately improved for permanent use — 
not crammed for recitation and a term credit and then forgotten. It is ap- 
parent, too, that the school had given her encouragement in independent 
work by testing it and recording her achievement. Her special work in 
general science and in French have already been described. At the begin- 
ning of her junior year she applied for a test in ancient history in which 
she had long been interested, though she had taken little of it in school; 
the result in this test showed the same high quality as her other work 
(col. 18). 

The personal history that parallels Margaret’s intellectual development 
furnishes important items. Under notable accomplishments (line 31) are a 
prize essay in 1925, the reading of Barrie complete when twelve years of 
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age, and, when thirteen, the reading and reviewing of all Shakespeare’s 
historical plays during a summer vacation. She was an active club girl, 
occasionally an executive (line 35) . In her early vocational choices (line 47) 
teaching, medicine and law rotate. She finally decides on teaching, then 
on college teaching, then on teaching of Latin and French. 

Data on the back of the card indicate that Margaret comes from a nor- 
mal American family in which the parents are without higher education 
(lines 61, 62). She has four brothers, three of whom have been at college 
(line 65) . Her personality ratings can only be regarded as vaguely suggestive. 
Judgments on this point are equivocal since they lack definition of the be- 
havior on which they are based. 

Altogether Margaret’s picture is that of a remarkably capable, steady, 
and independent mind developing admirably with an excellent background. 
She is undoubtedly a college risk of the first class. 

The Case of John Morton Smith, Jr} The facts concerning this boy were 
accidentally discovered in the records of a large city school which took ex- 
haustive measures of its pupils but made no use of them because of the lack 
of an effective way to assemble and present them. 

In 1927 John took college entrance examinations in five subjects with 
results indicated by the open circle in that column. He was refused admis- 
sion because in English he ranked among the lowest 16 per cent, because 
the principal, supervisor, and mathematics teacher (all .strangers to him) 
estimated his intelligence as below average, and because in a thrce-minule 
interview the college admissions officer could make nothing out of an ex- 
cessively shy, self-conscious, and excitable lad. 

The unused data in possession of the school when brought together in 
cumulative form tell a very different story; in fact they seem to indicate 
that the college officer who rejected this boy was actually dealing with a 
mind that should have been classed among the best 5 per cent of college 
risks. There are ten measures of John’s intelligence as shown in the I.Q. 
graph beginning in 1922, none of them falling below the ninety-fourth per- 
centile. There are four standard measurements in geography, three in 
American history, and one in economics — all above the ninety-seventh 
percentile. English fluctuates more widely but is nowhere below the eighty- 
fifth percentile, while of seven measures in French all but one are in the 
highest 2 per cent of modern language ability for the respective ages. The 
science line — general science, biology, physics, and chemistry — is lower 
but still well above the average. The four arithmetic measures are good, 
but the symbolic thinking required in algebra is indifterently done, and 
geometry is far down. Fearful of failure in the college examination in 

1 Carnegie Foundation for the Advancement of Teaching, Piogiam for a Study of the Relations of 
Secondary and Higher Hdutahon, pp. 2 fp. (New Yoik, 1928). 






















VOC«CTUOr,TlllflStNC!i 

Wy(ttr 

Wvitey 

A aw 

iNTmsisTtwwtti 

E-rtg" 1-»T 

I.1I' 

Fy F» I.1I 


I- A 


I1S.VW Wvitfty 



























CUMULATIVE RECORDS AND EDUCATIONAL GUIDANCE 149 

geometry, John’s parents hired a tutor who had him commit to memory as 
many theorems as possible with the purely chance result there indicated, 
Diawing hovers about the average. A Stenquist test of mechanical abil- 
ity shows poor success. Handwitnig is very poor, thus doubiless explain- 
ing the low college entrance mark m English -the paper was illegible. 
Height and weight lines are much under average Desiring to enter college 
a year earlier, the boy learned Spani.sh by himself when fourteen. I’lic school 
refused to admit him to the college c.xaminalion, hnt his teacher gave him 
a standard American Council Spanish test in which he scored in the ninely- 
seventh percentile for third-year students. The rating in oral Spanish at 
the same time was, of course, low. 

In extra-curricular activities the scattered obtainable facts about this 
boy make an impressive showing when they are pieced together. When 
twelve years old he brought to his English teacher an essay on “Shake- 
speare in Politics” highly documented from nearly every one of Shake- 
speare’s plays. The following summer, having studied French for two years, 
he read by himself certain editions of four French authors and took the 
French teacher’s examination thereon. Later he translated three short 
French comedies into English, and in his last year presented a lengthy 
study of geography that he had made from his French readings, Such work 
a.s this apparently earned him the maximum rating of “initiative” at the 
bottom of the card, although his first rating in that trait is the minimum 
because it was given by those in charge of group activities which he dis- 
liked. His “personality” rating is uniformly low. A psychiatrist rated him 
in 1923 as markedly introverted. His athletic activities include a little 
baseball (B), football (F), and tennis (Ten ) in early years, but after the 
age of thirteen these gioup sports give place to solitary hiking (H) with a 
book. Similarly, dramatics (Dr.) and debating (Deb.) give way to what 
is called “journalism” (J), which, however, was discovered to consist en- 
tirely of reviewing learned books for the local paper. His success at his 
summer jobs is good, his ambitions and interests are steady and consistent. 

Studied as a whole, this record gives indubitable indications of a mental- 
ity that may be close to genius. The separate hems taken alone count for 
little’ but tlie sweep of evidence across even si.x years of this boy’s life is 
unmistakable and should place the subject among those whom an insli- 
tution handles with the utmost care. It is doubtless an extreme instance, 
but, if a case so obvious as this can be so badly bungled in our administra- 
tive procedure, it seems likely that the average child must be a frerpient 
sufferer. 

After reviewing the different methods which have been tried to secure 
some reliable and accurate measures for predicting the probable success of 
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students, Professor Strang of Columbia University concludes with a state- 
ment which constitutes an appropriate summary of this chapter ; 

Predictions based on the data from cumulative records, involving as 
they do the many-sided aspects of the individual, seem to be the most sat- 
isfactory basis on which to advise boys and girls concerning their future 
educational plans. The cumulative record prevents a single non-typical 
performance from being given undue weight.^ 


1 Ruth Strang, Personal Development and Guidance in College and Secondary School, p. 133 (New 
York, 1931). 



CHAPTER IV 

EDUCATION, EXAMINATIONS, AND 
THE INDIVIDUAL 

T he discussion in the preceding chapters began wilh the criticisms of 
the traditional system of examinations in the United States, After a de- 
tailed consideration of the substitutes for traditional examinations it closed 
with the conclusion that the problem of examinations is not primarily one of 
discovering more accurate scientific and technical methods of constructing 
and scoring examinations The problem of examinations strikes at the very 
roots of the whole meaning and significance of education for society. It laises 
the question whether society can proceed, as it has in the main done in the 
past, on the assumption that there is only one pattern of culture or liberal 
education to which all must be moulded, as they advance from elementary 
to higher education. It involves a consideration of the meaning and effects 
of failure in education, and posits the question of the profit derived by a 
pupil exposed to standards of education, however sound and laudable they 
may be in theory, if he fails to come within measurable distance of attaining 
these standards.^ It inevitably brings up the problem of the social and eco- 
nomic distribution of individuals in society and the danger to social stability 
which may result from educational and vocational maladjustment. In the 
present crisis it raises the issue whether by an appropriate organization of 
education the emergence of educated proletariates with the tragedies that 
have been witnessed in Europe as the direct results of overcrowding in cer- 
tain professions can be avoided. This issue in turn leads to the question 
whether it is not the function of an educational system to promote the best 
happiness of the individual by putting him in the way of the highest develop- 
ment of which he is capable and which will contribute to the best progress of 
society itself. 

To approach the problems of education in this way may be a shock to those 
who fear that further differentiation in education and adaptation to the inter- 
ests and aptitudes of individual pupils and students may mean a departure 
from the Great Tradition, meaning by that the classical tradition, a knowl- 
edge of the best that has been said and thought in the past. While no one 


1 When the doetnne of formal discipline dominated education, it was claimed that even though these 
standards were not attained, the "mind” was teamed on the way With the leseuations and limitations 
that have been placed upon this dootime, the piobleiu in education has become one ot discoveung 
Such content as will piovide intellectual liaining and at the same tune have what Dr Abi aham Flexner 
desciibed as "affirmative values” for the learnei 
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would be disposed to doubt the sincerity of those who have a conLinued and 
abiding faith in the Great Tradition, it may still be maintained that they 
ignore the pragmatic demands of the situation which is developing every- 
where. Those who profited from the Great Tradition were in the past a 
selected minority; to-day the task is twofold: first, to re-define the concept of 
liberal education in terms more appropriate for the world in which we live, 
and, second, to provide appropriate types of education for the increasing 
numbers who are entering on some form of post-primary education and 
proceeding even beyond that stage. As these numbers increase, the range of 
individual differences of aptitude increases. It would be unfortunate for the 
world if the ideals of the Great Tradition and with it the ideals and stand- 
ards of scholarship were allowed to disappear, but all the evidence that can 
be gathered from the study of examinations points to the fact that success in 
this type of education demands special aptitude. It may even be asserted that 
the selection of those who have the ability to profit from il would help to per- 
petuate and strengthen it.^ Hence a demand for grealcr differenliaLion in 
programs of education, considered from one point of view, does not mean that 
the Great Tradition must be discarded but that il should be relained as one 
type in the program of differentiation. 

Society is to-day confronted with a different task in the organization of 
education from that which it was called upon to meet when one type of edu- 
cation was provided for the masses and another for the small minority . What- 
ever the political organization may be, the importance for society of a body 
of well-trained individuals is everywhere being recognized. This recognition 
does not, however, mean the same education for all. It means that measures 
must be devised whereby each individual may receive that type of education 
from which he can best profit. The traditional system of selection by exam- 
inations is beginning to be found inadequate for the purpose, whether from 
the point of view of individual pupils or of society itself. The essence of the 
problem is not the reliability of examinations and their scoring, but the valid- 
ity of education. Merely to discover the interests and abilities of individuals 
is not enough; there must also be another criterion and that can be found 
mainly in the social needs and requirements. Merely to follow individual in- 
terests and abilities in devising educational programs has too frequently been 
to follow the line of least resistance, to ti-ead the primrose path. In educa- 
tion as in life freedom always demands as its correlative a sense of respon- 
sibility. And this responsibility is to be found in the common duties which all 
members of a society must fulfill. In the words of Vittorino da Feltre, 

1 See note on p. 144. 
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Not everyone is called to be a lawyer, a physician, a philosopher, to live 
in the public eye, nor has everyone outstanding gifts of natural capacity, 
but all of us are created for the life of social duty, all are responsible for 
the personal influence which goes forth from usd 

The problems and questions which have been raised are not confined to 
the United States ; they are to-day world-wide. The United States is, however, 
in a better position to make a contribution to their solution because of con- 
ditions which do not as yet prevail elsewhere. Thei'c is, first, the widespread 
acceptance of the ideal of equality of opportunity, which after long years i.s 
beginning to be rescued from the danger of confusion with identity of oiipor- 
tunity. Secondly, the adaptation of education to changing social needs is not 
subject to the coercive restraints of a traditional concept of culture, the pos- 
session of which is the key to certain social and economic privileges ' Thirdly, 
there exists in the United States a venturesome spirit of experimentation, 
which, though at times and in some hands subject to the crudities of the half- 
educated man, does over a period of years yield salutary results ^ Fourthly, 
the consideration of educational problems and action based upon it are not 
vested in the hands of official adnunistrative authorities. 

While all these factors may from one point of view be regarded as detri- 
mental to anything like stability in educational ideals and practices, a study 
of the educational situations in other countries only reveals the existence of 
the same problems everywhere else and the urgent need of meeliug them 
soon, if the unrest of the rising generation is to be allayed The problems 
here discussed are as much social and economic as they are educational. 
Everywhere the need of providing more education at the secondary level is 
beginning to be recognized;® in most countries overcrowding in the univer- 

1 W H Woodward, Studies in Education during the Age oj the Renaissance, 1100-1600, pp 1^ f. 
(Caiiibiidge University Press, ISOb), 

3 It i.s not j-hvays cleai in those countries where the ti.idition of eiiltiiie has been most anlently pre- 
sei ved whether that has been possible because of a desire lor education foi its own .sake or for the re- 
wards that accompany its attaiiiinent. The tiadilional piogratn has at the same tune served as a method 
of selcetioii. Thus the French educational authorities in order to cuih oveiciowdiiig m the medical 
piofession introduced the classical studies as a compulsory requirement for students of medicine 

3 It happens too frequently thal thiough a ]ness mteicsted in O'cploitmg the sensational the foreigner 
heais more of these ciiidities than of the solid aceomplishmenls. But even in the ease of an authoiitative 
work the foreigner who derives his picture ot higher education in the United States fioni Ahi.ihaiii 
Flexner’s Uniueisities, Amei icon, English, Ueiman (New York, 1930) has tailed to read Dr. Fle'cnei 's 
prefatory statement (p viii) that he has given moifc attention to a consideration of where imiveisities 
now satisfy and where they fall short of his own “idea of a modern nniveisity,” than to their ineiils 

4 See W. Kotschnig, Education Dirigee, Etude Intel nationale stir le Sui peuplcmeiit des Unicei sites et le 
Chdmage des Etudiaiils Diplomes (L'Entr’-Alde Uruversitaire Internationale, Geneva, 193j). 

In the United States, as already indicated in the pi cceding chapters, the problems leaeh into thecol- 
1 egc level. 
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sities is looked upon as a social menace; in many countries there is a search 
for methods and techniques by which the right education may be provided 
for the right pupil. 

A study of examinations, unless it is approached in the light of the issues 
here raised, must inevitably concern itself merely with the machinery of 
marking in order to adhere to some arbitrary standards But a candidate or 
the teacher of a candidate who has passed or failed Icnows little more about 
what the examination has revealed concerning his ability. Nor is it very help- 
ful to the teacher to learn from the blanket reports on examinations that 
In the set books of the English paper the more mechanical part of the 
work (i.e. contexts, reproductions, etc.) was usually adequate, but ques- 
tions which called for any originality of treatment too often revealed a 
lack of resourcefulness. . . . In history the general standard reached seemed 
to be somewhat lower than usual, though in some schools the answers to 
questions on social and economic history had definitely improved. Insufli' 
cient attention was paid to geography in most schools. . . . In the chemistry 
section of the physics and chemistry paper, the general standard was defi- 
nitely weaker than in recent years, many candidates being largely igno- 
rant of the subject. Answers failed, however, not only through ignorance of 
facts, but because of an outlook on the subject wholly devoid of common 
sense.^ 

Such a report no doubt has its value but it tends to perpetuate a game 
between teachers and pupils, on the one hand, and examiners on the other; 
neither the general statements nor the individual results give the teachers 
much guidance on how to deal effectively with each pupil. The most fre- 
quent objection which is brought against the new type, objective test is that 
its measures “mere knowledge” only and not the higher processes, which it 
is claimed the traditional essay examination can test adequately. The follow- 
ing statement by the Panel of Investigators appointed to inquire into sec- 
ondary school examinations in England is pertinent on this point: 

Admittedly Examiners are oppressed by tbe fear that candidates may 
obtain pass or credit by ‘cramming,’ a process which is not always dis- 
tinguishable from careful teaching and intensive work. To prevent cram- 

1 “For each paper the crucial question to be answered was ‘What in terms of peiformance, does a pass 
or credit in this subject mean*" or, more particularly, ‘Did the scripts of the candidates who just passed 
reveal work which was tolerable or ivas it in fact of little or no worth?’ ‘Could the work of the candi- 
dates who just got credit be legarded as reasonably good?’ ’’ From The School Certificate Examination 
being the Eeport of the Panel of InvestigaiOTS appointed by the Secondary Schools Examinations Council 
to Enquire into the Eight Approved School Gertijkale Examinations, p, 53 (London, 1932). 

^ From the report of the O'cfotd and Cambridge Schools Examination Boaid, presented to Convoca- 
tion, quoted in The Manchester Guardian, February 11, 1936. 
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questions are set inviting candidates to contrast, compare, or criti- 
cize groups of facts or individuals. But the experienced teacher is equal to 
this device, and the pupil with a good memory absorbs the subheadings of 
a comparison or criticism from dictated notes as easily as he crams a series 
of facts from a textbook. The pupil with a weaker memory writes down 
such facts as seem more or less germane to the question. In the latter case 
success or failure depends on the Examiner’s attitude; some consider an 
accurate knowledge of such facts worthy of a credit; others hold that this 
knowledge, unless logically applied, scarcely deserves a pass. Examiners 
report regretfully that such questions cither produce irrelevant answers 
or attract very few candidates. In the judgment of the Investigators the 
sustained attempt to make History papers test the logical and critical 
powers of the sixteen year old candidate has proved a failure. 

Perhaps even less satisfactory results have ensued from the use of 
‘academic’ or abstract language. Most pupils who take the examination 
can understand concrete facts and attach the right meaning to straight- 
forward questions. Few have the knack of absorbing generalities or dis- 
cussing them with plausibility. The results of training an immature mind 
to deal in ideas and idioms beyond its grasp are short-lived, so far as they 
concern historical Icnowledge But there may be permanent effects on a 
candidate’s intellectual sincerity.^ 

This may be supplemented with a further statement from the same report; 

The mass of scripts which have been placed before the Investigators 
affords convincing evidence that by encouraging the reproduction of life- 
less textbook formulae the existing type of examination deadens the pupil’s 
interest in what should be one of the most stimulating subjects [history] 
in the school curriculum.® 

The reports of the examiners of the University of Paris on the haocalaurSat 
examination of 1935 are of a similar character.® In the natural sciences, the 
examiners found that 

The defects most frequently noted by the examiners, apart from lack 
of information shown by some of the lazy or unprepared candidates, was 
the deficiency in method of exposition, absence of plan, negligibility of 
drawing, and carelessness in grammar and spelling. In the oral examina- 
tion, while there are candidates who give proof of intelligence and think- 
ing, there are still too many who yield to the tendency of trying to present 

1 The School Certificate Examination, p. 81. 

2 Ibid., p. 84. 

^ The quotations which follow are cited from a mimeographed circular, Rapport sur les Emmens du 
Baccalaiiriat de I’Enseignemert Secondatre en 1935, issued by the Office da EaccalaurSat of the Uni- 
versity of Paris. 
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an entirely formal exposition without order or logic. It is diflicull to make 
such candidates give precise facts or even to get them to consider the ob- 
servations and experiments which serve as the basis of their conclusions or 
theories. 

The examiners of both the written and oral examinations in French 

are unanimous in directing the attention of candidates to the importance 
of writing correctly and with due regard to spelling. ‘Of 134 papers,’ writes 
one examiner, T hardly found 20 which were free from grammatical mis- 
takes and errors in spelling.’ Further, too many candidates showed them- 
selves incapable of drawing up a plan ‘One has the impression,’ according 
to one report, ‘that the pupils start right off without thinldng and with- 
out a plan.’ Frequently some candidates ‘instead of dealing with the topics 
set develop topics already prepared.’ 

In the modern foreign language papers 

a consideration of the marks obtained in the written and oi-al examina- 
tions, in lien of detailed reports by the examiners, shows that while a sudi- 
ciently large group of candidates have given evidence of adequately somul 
mastery, the rest, a more numerous group, do not appear Lo have derived 
much advantage from the instruction which they received in the six 
years of the course. 

According to the report of one examiner in history and geography 
the candidates in general seem to have a sufficient knowledge of the course. 
As usual too many have obviously used resumes and it is useless to expect 
them to reflect on the facts and to indicate the relations which exist be- 
tween them. 

As in the case of the examinations conducted by the New York State 
Board of Regents and the College Entrance Examination Board the reten- 
tion of the external examinations in England is justified on the ground that 
there is almost perfect agreement between the results and the teachers’ ex- 
pectations ^ Thus the Secretary of Local Examinations, Oxford University, 
at the close of a critique of A?i Examination of Examinations conducted by 
Sir Philip liar tog and Dr. E. C. Rhodes, finally appeals to the teachers 

Perhaps I may be allowed to send a word of comfort and advice to young 
teachers who have not yet joined the conspiracy of silence and whose con- 
sciences are still tender. They must be feeling that they will never again 
dare to mark their pupils’ work or say that an answer to a question is 

1 One examinei m the report on the baccalmn eat mentioned above state? that the school records {livrefs 
irolaires) presented by candidates from lycees and colleges in general reveal then standing accurately; 
according to two examiners the same is not true of records from private schools. 
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good, bad, or indifferent. They may take heart, for they will find that, 
somehow or other, the verdicts of examiners coincide with their own in a 
very large number of cases and that this number will increase as they gain 
experience. In such cases they can use the examination results to vindicate 
their own forecasts.^ 

Such a justification fails to meet the educational im[)lications involved. 
For if teachers can forecast the results of examinations so suece.ssfully, it 
would add to their professional status and dignity to hi' allowed to cerLilicate 
students themselves, since the margin of error is so small. And, secondly, if 
pupils can succeed only to the degree indicated in the reports of tlie Oxford 
and Cambridge Schools Examination Board and the Panel of Investigators, 
then the efforts to secure reliability of marking are not justified by the result.s, 
and the teachers should be placed in the position of making constant ap- 
praisals which they can interpret adequately and whose interpretations will 
enable them to deal with each pupil appropriately. The justification of an 
educational system does not rest upon ability to anticipate success or failure 
and to prove these antiepations by examinations, but rather in using such 
information to adapt the work to the known abilities of the pupils. 

This, it is submitted, is what is claimed for the new type tests, not that 
they can be more accurately and more reliably scored but that they furnish 
a more adequate basis for guiding, helping, and advising each pupil. It is ad- 
mitted by those who can speak with authority that the tests themselves are 
not yet perfect. The same admission has been made both by the Secretary 
of the College Entrance Examination Board in the United States (see p 48) 
and by the Panel of Investigators in England (see pp. 154 f.) But another 
claim is also made as the result of experimeiilution over nearly two decades, 
that no test, however perfect, can tell everything that needs to be known 
about a pupil 

If it is true, and there is now adequate reason to believe that it is true, that 
so far as the machinery of scoring is concerned the results obtained from the 
new type test are more reliable than those secured by the traditional exam- 
ination, and the former have the further advantage of providing diagnostic 
data, the situation becomes more aggravated when the traditional examina- 
tion — the spasmodic, snapshot picture of a candidate — is used not only to 

^ The Times Editcatinnnl ^^uppleiiient, Decembei 1935, p. 116 In a later aiticle, however, in the 
Joiiinal of Bihttaiioii (“Examinations*’), May 1, 1936, pp fF , Mr Burnet does not seem to be 
inclined to show the same unlunited eonhdence mthe school leooids ^vhich are tsonictimes submitted. 
The Noithern LTniversitics Joint Matiiculation Board, to meet the criticisms of examinations iinphed 
in the Haitog lepoit, has also published a repoit debOiibing* the methods of inaiking })apeis, wliicli 
prove that teach ei&’ expectations arc fulfilled in per cent of the eases 
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measure what he has achieved but what his promise for further j)rogress 
may be, that is to say, for purposes of selection for a particular type of edu- 
cation. In England Professor C. W. Valentine of the University of Birming- 
ham has shown the unreliability of the first selective examination by which 
boys and girls at about the age of eleven are sorted out for secondary, central, 
and “senior” schools.^ In the first secondary schools examination, which is 
both a terminal and a qualifying examination, the average percentage of 
passes over a period of years has been 65 per cent with the probability that 
the examination is not taken by all the pupils who have spent four years in a 
secondary school. 

In Prance a generous system of scholarships for post-primary education is 
administered on the basis of a traditional examination; fees have been abol- 
ished in the secondary schools but the authorities are still struggling with the 
problem of devising a reliable method for selecting those who are most likely 
to succeed in the type of education there offered. In the haccalaur6al exam- 
inations at the close of the secondary school career only 45 per cent of the 
candidates pass the first part, and of these about 55 per cent pass the second 
part, while the distribution of passes in the various academies, udraiuisLra- 
tive areas for education, ranges from 20 per cent to 80 per cent. 

In Germany an investigation sponsored by the former Minister of Educa- 
tion in Saxony, Dr. W. Hartnacke,®* revealed the diversity of standards in the 
secondary schools of the state, which in the past have always been regarded 
as homogeneous in standards, and the diversity of abilities among the stu- 
dents who have nevertheless crowded into the universities as a supposedly 
homogeneous group. Admissions to the German universities have been re- 
duced to about one-third of the number entitled to proceed from the sec- 
ondary schools on the basis of the Reifeprufung,^ but no provision has yet 
been made in the form of differentiated types of education for those adoles- 
cents who in future will hesitate to undertake the hazard of a nine-year 
course, only to be turned aside from the universities in the end. 

Examples of the same Idnd could be cited from other countries.^ The con- 

1 C. W. Valentine, The HeUahility of Examinations (London, 1933) The “seniov" school is the lecently 
developed upper section of the elementary School for childien from eleven up to fourteen or fifteen. 

2 W. Hartnacke and E. Wohlfahit, Oeist und Torheit auf Pnmanerhanken (Diesden, 193‘li). 

3 For the Law against Overcrowding in the Universities (April 25, 1933) and the subsequent decree of 
December 28, 1933, see 1. L. Kandel, The Making of Nazis, pp 102 ff (New York, 1935). Since this 
leducbon has been in effect a smaller number than those actually entitled to do so under the regulations 
have actually proceeded to the universities. 

■< The three Scandinavian countries, Norway, Sweden, and Denmark, aie confronted with the same 
problem: overcrowding m the secondary schools, leading to overcrowding in the universities, leading 
in turn to overcrowding in the liberal piofessions, and accompanied by criticisms that standards are 
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ditions, which have developed in part from the extension of education up- 
wards, and in part from the intensive competition due to the economic situa- 
tion following the World War, all point to the conclusion that the central 
problem in the administration of national systems of education is, to quote 
Sir Graham Balfour’s statement again, “To enable the right pupils to receive 
the right edueation from the right teachers, at a cost within the means of the 
State, under conditions which will enable the pupils best to profit by their 
training.” This statement may be paralleled by the terse summary of the 
problem confronting France in her efforts to give reality to the plans for the 
Scale unique. In discussing this problem M. Anatole de Monzie, former Minis- 
ter of National Education, stated it could only be solved by GratuitS, SelecLion, 
el Rationalisation — a system of free education implies selection and distribu- 
tion of pupils; to this summary there should have been added Orientation or 
guidance to make it complete. In the same connection a Committee appointed 
to inquire into the Scole unique recommended the creation in the Ministry of 
National Education of a Permanent Commission for Selection and Guidance 
{Commission Permanente de SSlection et Orientation) . 

The crucial problem of the day centers, therefore, not so much upon the 
question of improving the machinery of examinations. As far as the individual 
pupil is concerned, he will be no better off educationally no matter how reli- 
able may be the techniques by which he just manages to pass or fail, The ulti- 
mate question is the validity of the type of education from which he is capa- 
ble of profiting. To improve the techniques for securing reliability of scoring 
while retaining a rigid curriculum may be a step in advance, but it would still 
mean concentration on the machinery of examinations alone. The task, how- 
ever, is to read and interpret the results of examinations in such a way as to 
discover what is best for the individual’s education and through the indi- 
vidual for the society in which he lives. The validity of an education will 
accordingly have to be defined in terms of the needs both of the individual 
and of society.^ 

being lowered. Italy has attempted to meet the situation through the Gentile reform which added to 
the variety of schools at the secondary level but .still basci admissions empirically on the traditional 
examinations. More recently the Soviet Republics of Russia, which entered blithely on a scheme of 
educational oppoitunlties without demanding any qualifications othci than political, have adopted a 
rigid system of annual examinations fiom the early eleiiienlary school years on. Japan has for several 
years been shugghng with the problem of overciowding in the universities, which has resulted m large 
numbers of students and giaduates “harboring dangerous thoughts.” 

i The extent to which individual difiiculties could be met by better methods of instruction, smaller 
classes, personal attention, and a breakdown of the lockstep time requirements under which all pupils 
are compelled to complete a given course in the same amount of time is a question which requires 
further investigation. The uniform time requirement has been abandoned in the University of Chicago 
experiment. 
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The attack on the problem of examinations in the United Slates began 
with the application of statistical methods to prove their unreliability in 
the traditional form. They began to be replaced by tests which would be 
more objective, more accurate, and more reliable. In time it was recognized 
that, even though this end was achieved, the result was still in terms of 
“pass” or “fail.” It has been realized only within the last two decades that 
tests cannot be ends in themselves but can best serve their purpose as instru- 
ments for diagnosis, remedial work, and, finally, guidance. As instruments 
for educational guidance they have found their place and have won greater 
confidence. But even as instruments for educational guidance it is now gen- 
erally admitted that tests cannot tell the whole story, that their predictive 
value is limited, and that if used only once their value is not much greater 
tlian that of the single examination of the traditional type. 

This realization has led to an emphasis on the coni imious use of tests over 
a period of years as a guide to the intellectual growth and (hwelopmcuL of a 
pupil. Beyond this has come the recognition that for adequiilc guidance' the 
results of tests must be supplemented by more detailed iiifornud ion about I he 
pupil’s personality as a whole. Hence the adoption of the cumulative record 
card, continuous, comprehensive, detailed, which should provide a record of 
teachers’ judgments, school marks, results of comparable tests which reveal 
rate and directions of growth, health, character, interests, aiul social condi- 
tions. 

The adoption of the new type examination was not accepted without criti- 
cism. In the zeal to create a science of education, comparable with the physi- 
cal sciences, too much was claimed for the new instruments by the early en- 
thusiasts. Confronted by a certain inertia and opposition on the part of those 
who were not willing to give up the traditional examinations without a strug- 
gle, the enthusiasts, trained in the techniques, began to draw up tests which 
the subject matter specialists could not accept. Only gradually has there 
been reached in the construction of tests a rapprochement which has re- 
sulted in codperation between the technical expert and the subject matter 
specialist. Nor is it yet claimed by those who are qualified to speak with 
authority that the existing tests have reached perfection. They ai-e still 
subject to the criticism that they test “mere knowledge,” but, as has been 
pointed out earlier, while the acquisition of knowledge is not the whole of 
education, an education without the acquisition of enduring and usable 
knowledge is inconceivable. Further, the criticism that the tests test only 
knowledge is denied and there is ample evidence to prove that even the recall 
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of knowledge involves reasoning, and that the tests are not merely tests of 
knowledge but also of the higher intellectual processes. 

Again, those who are interested in education as a whole as well as in the 
techniques of measurement have at no time claimed that the new type tests 
are a complete substitute for other forms of examinations, training, and in- 
struction. To prove that the marking of an essay examination i.s likely to be 
subjective and unreliable is not to deny the value of training in the writing 
of essays, even though that may be one of the unforLunatc but unsupported 
results of the test movement. It is at this point that further developments in 
those countries which have been investigating their systems of examinations 
will prove of value to American educators For the real test of an education in 
the European school systems is not only mastery of knowledge but ability 
to organize and communicate it, and, so long as thh continues to be the test, 
it is not likely to be surrendered readily. Nor should it be. 

On the other hand, if the results of the investigations into examinations 
carry conviction, these countries will be confronted with the task of combin- 
ing the best in the traditional education with the best that can be found in 
the way of more accurate, reliable, and objective substitutes for the tradi- 
tional examination. It will be to this solution that American educators will 
have to devote their interest and attention. For the European educators, 
however, the contribution which the United States can make lies not so much 
in the substitutes which have been developed for the traditional examination. 
For them the most important contribution lies in the conclusion that these 
substitutes, adequately supplemented with other information, constitute in- 
struments that can be employed for the educational guidance of increasing 
numbers of young people whose education is beginning to create a social 
problem without parallel and without precedent. And yet not without paral- 
lel or precedent in theory! Plato had already given some attention to the 
problem and sought to provide the right education for the right individual in 
the just state on the basis of such psychological differentiation as he had at 
his command. But for the present study there is no more fitting and appro- 
priate statement than John Locke’s analysis of the problem with which the 
educational world must struggle in the twentieth century : 

God has stamp’d certain Characters upon Mens Minds, which like their 
Shapes, may perhaps be a little mended; but can hardly be totally alter’d 
and transform’d into the contrary. 

He therefore, that is about Children, should well study their Natures 
and Aptitudes, and see, by often trials, what turn they easily take, and 
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what becomes them; observe what their Native Slock is, how it may be 
improved, and what it is fit for: He should consider, whal they want; 
whether they be capable of having it wi'ought into them by industry, and 
incorporated there by Practice; and whether it be worth while to endeavour 
it. For in many cases, all that we can do, or should aim at, is to make the 
best of what Nature has given; to prevent the Vices and Faults to which 
such a Constitution is most inclined, and give it all the Advantages it is 
capable of. Every one’s Natural Genius should be carried as far as it could, 
but to Attempt the putting another upon him, will be buL Labour in vain : 
and what is so Plaister’d on, will at best sit but untowardly, and have al- 
ways hanging to it the Ungracefulness of Constraint and Affectation,^ 

Three hundred years later, in 1892, President Charles W. Eliot presented 
the sanae problem from the modern point of view: 

To discriminate between pupils of different capacity, to select the com- 
petent for suitable instruction, and to advance each pupil with appro- 
priate rapidity, will ultimately become, I believe, the most imj)orianl 
functions of the public-school administrator — ihosc functions in which he 
or she will be most serviceable to families and to the stale. 

But by no one has the problem been more succinctly slated than by Sir 
Graham Balfour in his definition of the function of the administration of edu- 
cation, a definition which has practically served as a text for this volume: 

To enable the right pupils to receive the right education from the right 
teachers at a cost within the means of the State under conditions which 
will enable the pupils best to profit by their training. 

This is ultimately the problem with which examinations and the distri- 
bution of education must concern itself. 


' John Locke, Some Thoughts Concerning Education. 

2 C. W. Eliot, Educational Reform, p, 36J (New York, 1898). 
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The International Examinations Inquiry 

This summary of the International ExaminaLions Inquii y mas i fad hy the author hef in e the Fourth 
Educational Conference of the Committees on Personnel Methods and on Educational Testing of 
the American Council on Education, the Commission on the Relation of Hchool and College of the 
Progressive Education Association, the Cobperalive Test Service, and the Educational Records 
Bureau, and ts reprinted from The Educational Ilccord, January, 1936, Supplement No. 9 

I T is a generally accepted fact m comparative education Uiat educational sys- 
tems, theories, and practices are detei mined by the ethos of tlic people -whoni 
they are designed to serve — their cultural, social, and political traditions, values, 
and aspirations And yet, there is no country m the vvoild today m 'which then' are 
not discernible evidences of widespiead utuest m education, and the crucial prob- 
lem in this unrest is how to discover and provide the right education foi the right 
individual under the right teacher. Whatever the backgrounds may be, whether 
one starts fiom the Right or Left politically, whether there is accepted a iigid deli- 
nition of the purposes of education and the meaning of culture or an absence of a 
standardized currency of educational values, the central and most pressing prob- 
lem appears to be the same, — ^tho provision and distribution of education consist ent 
with the needs of society and adapted to the aptitudes of those who aie to be edu- 
cated The problem is not new, Plato struggled with it and within the limitb of the 
psychology of Ins day attempted to provide a solution Ibi his ideal state The 
national systems of education winch began to be created early in the nineteenth 
centuiy solved the problem simply by providing two types of education — one for 
the masses and another for a select minority. This general form, based on social 
stratification, was continued and, when the piogress of the nineteenth century 
demanded variation and differentiation, there developed an elementary branch 
with its ramifications upwards and the secondary branch leading to the universities 
and professional preparation. Here and there slight and tenuous biidge.s wore 
thrown across the two systems, over wliichthe ablest could find their way from the 
lower to the higher branch. 

The rapid changes in the social, political, and economic realm which character- 
ized the early years of the twentieth century and whose tempo was quickened by 
the Great War diiected attention to education more intensively than ever before 
in its history It began to ho generally recognized tiiat an elementary education in 
itself provides an inadequate preparation for life m modern society, the wide.spread 
acceptance for a shoit time after the War of the democratic ideal brought with it 
demands for increased equality of educational oppoi'tunities, the intensification of 
interiiationul competition brought 'with it the recognition that nioic education 
must be provided, and in those countries which abandoned the democratic ideal 
the recognition of the value of extended education iii the interests both of national 
welfare and the rapidly increasing body of unemployable youth helped to save the 
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demand for a more generous distribution of educntion. The icsuU is seen m tlio 
slow but inevitable abandonment of the dual system of education —one for the 
masses and another for the select group — and the adoption of a common foundation 
on the basis of which differentiated types of post-primary education are to be builL. 

The American tradition has proceeded on different lines. The nineteenth century 
opened with the acceptance, at first as an ideal and later as a reality, of the piinciple 
of equality of educational opportunity which resulted in the adoption of a unitary, 
articulated system from the lowest grade of school to the university. It was not, 
however, until the opening of the present century that the full implications of tins 
ideal were realized. Dissatisfaction with what was described as the domination of 
college entrance requirements opened the way to greater flexibility in the piograms 
of the high school, a flexibility which was still further Increased by studies of elim- 
ination, mortality, and individual differences. The expansion of the high school 
offerings has proceeded apace and has only served to bring new problems of edu- 
cational adaptation and adjustment in its train. Apparently something more was 
needed than the mere provision of an extensive a la carte ediicRlioiial moim, leav- 
ing the pupil to choose as he pleases. 

Thus allowing for the differences in backgrounds and cultural 1 radii ious and 
starting from two extreme points of view the European countilcs and tlic United 
States seem to be converging toward the same problem — llie diffcrcnl iatioii and 
distribution of education. The European countries are on the eve of providing 
differentiated types of schools for differentiated abilities; the United States is con- 
fronted with the task of adjusting education to the needs and capacities of indi- 
vidual pupils but within the same institution. The European situation is, however, 
complicated by two factors which are not as potent and influential in the United 
States. The first of these is the jealous respect for a strong tradition of culture and 
liberal education, which unfortunately no longer exists in the United States. Sec- 
ondly, the European problem is complicated by what may be called the concept of 
education for status — the social and economic valuation placed upon an education 
which leads to certain preferred occupations and professions and which under 
present conditions has brought with it overcrowding in the universities and the 
liberal professions. The problem thus resolves itself in all countries into the ne- 
cessity of defining and providing the right education for the right individual under 
the right teacher, and this means, although it is not seen as clearly in some coun- 
tries as in others, the necessity of devising methods whereby differences in aptitudes 
may he discovered. 

In so far as attempts have been made to discover such differences the sole re- 
liance in the past and with few exceptions in the present has been upon examina- 
tions of the traditional type. Indeed, it might almost be said that if Socrates were 
to return to earth he might gain the impression that his beautiful statement '''’The 
life which is unexarained is not worth living” had been accepted too literally and 
somewhat extravagantly, at least for that part of mankind which is under educa- 
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tional tutelage. (Lest we in the United States he too complacent on this subject, 
it may be well to point out that the late Di‘. Carl Becker, former Minister of Edu- 
cation in Prussia, stated at the first Conference on Examinations that the number 
of examinations in Germany, reputedly the land of examinations, “is considerably 
less than in the United States of Ameiica, wheie students are being perpetually 
examined."”) . . . 

Under the sponsorship of the Carnegie Corporation, Dr. Monroe, as director of 
the International Institute of Teachers College, Columbia Univeisity, was ap- 
pointed to organize and administer what came to be known as the International 
Examinations Inquiry. 

The first Conference on Examinations was held at Eastbourne, England, in May, 
1931, and was attended by delegate.s invited because of their known interest m the 
subject from England, France, Germany, Scotland, Switzerland, and tlie United 
States. There were twenty-eight delegates in all, a number which made round- 
table discussion possible. The absence of prepared papers, except some giving gen- 
eral descriptions of the educational systems of the countries represented, conduced 
to an informality and spontaneity of discussion which ranged over the whole field 
of education, general and vocational. To the student who is interested in under- 
standing the educational values of the nations represented I can suggest no better 
source material than can be found in the eloquent statements reported in the Con- 
ference on Examinations (Bureau of Publications, Teachers College, Columbia Uni- 
versity, 1931) The technician may not learn much from tliis report about the scien- 
tific conduct of examinations, but to the American technician the report c.an be 
recommended if only to obtain an understanding and appreciation of the matrix in 
which the problem of examinations is closely embedded. 

The purposes of examinations were succinctly analyzed in the address with 
wliich Dr. Monroe opened the Conference Examinations may be used (1) as a means 
of instruction, (St) as a form of educational administration; (3) for purposes of ad- 
mission to various occupations, professions, and government service; and (4) as a 
means of social control. Three aspects of the problem appeared to dominate the 
discussion. The first centered round the question of social justice m the distribu- 
tion of education for the development of individual talent, the second was concerned 
with the ques tion of the selection and maintenance of an elite, the third was devoted 
to discussions of the meaning of culture, which ranged from the insistence of the 
French group on the importance of safeguarding culture gdnerale against attack to 
the recognition that civilization is changing and our concept of culture must change 
with it. From the French point of view it was admitted that some experimentation 
with examinations is desirable but that ultimately the undisputed ideal must pre- 
vail From the opposed point of view the pithy statement was made by Professor C. 
Delisle Burns that “One of the worst troubles in the whole examination system is 
that it has been devised by professors, and the best thing that professors can think of 
is themselves ; they therefore test candidates by what are tests of competence for pro - 
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fe&sors, but not for bankeis and other poisons.” Changas are going on all around 
us, “and we are sLill clinging to the old idea that we must produce pci sons and 
test them in the old way.” 

If little was contributed, except by Professors Thorndike and Judd, on the tech- 
nical .aspects of examinations, it may be said by way of general summary that the 
discussions at the First Conference helped to make clear that the problem of ex- 
aminations can only be attacked after the pui’poses of education, its meaning and 
oiganization, have been clarified. If one may hazard an opinion in the light of the 
development of examinations and their substitutes in this country it is along these 
lines that the method of approach at the First Conference has a distinct contribu- 
tion to make to American educators It is significant that at no time in the seven 
sessions of the Confeience was a voice raised in favor of dispensing altogether with 
examinations of some kind. The crux of the problem was .stated by one of the dele- 
gates from Scotland, where greater pi ogress has been made than elsewhere, largely 
through the efforts of the Scottish Council for Research in Education, in the use of 
scientific techniques of measurement. Education authorities in Scotland were al- 
ready convinced that the existing system of examinations is unsatisfactory, but the 
question which they put is “What have you by way of substitute',” a question to 
which a small group in Germany was already beginning to provide an answoi in the 
development of examinations that are both just to the pupil and have predictive 
value 

The value of the Conference is best described in the words of one of the distin- 
guished delegates. Sir Michael Sadler, who said: 

Never in a long life have I been to an educational conference more interesting 
or more impressive than this We have met here from seveial countries and speak 
different languages and yet understand one another so perfectly that wo might 
come from different states in one union. We are facing the same problem. We 
cherish the same hopes We are all thinking of the future of humanity. The dif- 
ferences of language have simply added to the richness and interest of the dis- 
cussion. 

The result of the Conference was the unanimous recognition that here is a prob- 
lem which is at once technical and, even more important, social in its ramifica- 
tions, that it cannot be attacked fiom a unitary point of view, that public opinion 
on tlie subject has not reached the same stage in all countries, and that each 
country must develop its own resources and methods for investigating the problem. 
To this end national committees were appointed in each of the countries repre- 
sented at the Conference to study the problem in ways most appropriate to their 
own situation. The furthei continuance of the Inquiry was made possible, as was 
the first Conference, by the generosity and interest of the Carnegie Corporation 
and the Carnegie Foundation. 

National committees weie accordingly organized in England, France, Germany, 
and Scotland. In Switzerland Professor Bovet undertook the preparation of a study 
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of the long history of the examination of army conscripts. The Committees m Eng- 
land and France had greater obstacles to overcome than the Scottish and German 
Committees. The Scottish Committee continued its studies along lines already ini- 
tiated by the Research Council. Germany was already confronted by a very prac- 
tical and very urgent situation, secondary schools and universities were overcrowded , 
the university authorities professed to see a lowering of standards in the post- War 
students, and the professions were also overcrowded; and the German llcfiublic 
was in any case more ready for experimentation in education than either France 
or England. In the latter country Sir Philip Ilartog, the Duector of the Inquiiy 
and long a critic of the system of examinations, in seeking the codpoi atioii of one 
of the universities in the investigation was met with the statement, ‘"We think that 
here we know everything there is to be known about examinations”, in the fouiier 
M Desclos, the Director of the French Inquiry, attributes the faiku'e of inoie 
than 2,800 out of 3,000 teachers and administrators to reply to a questionnaire on 
examinations to the fact that they have no doubt as to the impeccability of the 
findings of the examiners, who can be trusted to continue their woik to the satis- 
faction of all concerned. 

The task of the English and French Committees was accordingly defined by the 
situation, they had to prove in the most accinate and convincing manner possible 
the unreliability of marking in the existing practice of examinations in order to 
shake the prevailing complacency and before further investigations looking to re- 
form could be undertaken. It was already evident at an Interim Conference of com- 
mittee directors, held in London m June, 1933, that the members of at least one of 
the committees had themselves already received a greater shoclc to their complacency 
than they had expected in 1931, a fact which only strengthened then resolution to 
probe further It may be claimed that the English and French Committees were 
only repeating studies and techniques on an aspect of examinations already closed 
and settled in the United States from the scientific point of view nearly a generation 
ago This objection only brings into the foreground the fact that the educafional 
problems can only be solved in the light of local cultural and other bacligroiinds. 

The final reports of the invc.stigations which had been conducted over the pre- 
vious four years weie presented at the Thud Conference on Exauunations held at 
Folkestone, England, in June of this year. The same countries were leprcsentecl as 
at the First Conference with the addition of observers invited fiom Finland, Nor- 
way, Sweden, and Australia The Third Conference differed from the Fir.st only in 
the fact that prepared reports were presented, as at the First Conference the ad- 
vantages of intimate discussions and questions from a vaiiety of backgrounds and 
familiarity with the issues involved again lielped to clanfy the problems luised. 

The English Committee had devoted its investigations to testing concurrences 
of a number of independent examiners and of independent boards of examiners in. 
marking the same set of papers, the purpose of the second study was to tost the 
claim that individual Idiosyncrasies of examiners are ironed out when the marking 
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is done by a board. As compared with earlier experiments conducted in this country 
the papers used in the investigations were actual papers written in actual examina- 
tions. These papers covered a wide range of examinations, both qualifying and se- 
lective, and included papers written in the eleven plus or special place examination, 
a college scholarship examination, university honours examinations in histoiy and 
mathematics, and secondary school certificate examinations in Latin, French, chem- 
istry, and history. An investigation was also conducted on the method of interview 
on the model of the Civil Service Examination. Examiners were selected from actual 
examining panels, were paid, and were given all the time that they needed £¥617 
known variation of the examining technique was used in order to insure accuracy — 
the same system of marking was employed as in the original examination; the same 
examiners marked the same papers twice at an interval of a year; two groups of 
examiners were employed on the same papers, general standards and details of 
marking were discussed In tiro groups of examiners under the direction of chief 
examiners, trial markings were submitted to criticism, an English essay was marked 
once by general impression and then by details; and numerical and literal marks 
were given 

The French Committee proceeded on its investigations along much the same lines 
but concentrated more specifically upon the most crucial of French examinations — 
the baccalaurSat, which comes at the close of secondary education. One hundred 
papers in six of the subjects of the examination — French essay, Latin translation, 
English, mathematics, physics, and the dissertation in philosophy — ^were each sub- 
mitted to marking by five examiners. The papers were marked in the customaiy 
way and each examiner handed in reports on methods of marking employed, quali- 
ties and defects looked for, their relative importance, and the proportion of the 
total marks allotted to the several qualities discovered. In another study a French 
essay was marked by 76 examiners. 

The detailed results of these investigations cannot be announced in advance of 
their publication by the committees concerned. Anyone familiar with similar studies 
will guess correctly that there was discovered a great degree of unreliability in the 
marking, that the fate of candidates in examinations may differ with the different 
examiners, that on the Avhole candidates are exposed to the unfairness of chance. 
A number of side issues emerged in the discussion of the results — What is the peda- 
gogical function of examinations.'* Do examinations exercis^ any effect upon the 
work of the schools^ Is the marking of an examination an art or a scientific process? 
What would be the effect of new methods of examining upon the traditional values 
in education? Can examinations of any kind succeed in measuring all the qualities 
of a good education? How can justice be done to pupils of different abilities either 
by existing or by new methods of testing^* It is obvious from the discussions at both 
the First and Third Conferences that the subject of the Inquiry transcends the 
mere question of new devices and techniques of examination and that the techni- 
cian must work in close cooperation with the educational theorist and statesman, 
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and that even then the question, as seen by the French and English educators, 
still remains whether what is most valuable in education can be measured It is for 
this reason that the English Committee became interested m studying the method 
of the interview and the French are planning to undertake a study of their oral 
examinations, as rvell as to strengthen the results so far obtained by investigations 
into the examinations for the cejtificat d' etudes ptimaires and for national scholar- 
ships. The English Committee began its investigations with some anticipation of 
the results that would be reached and with the intention of expressing these results 
in such a form that they would carry conviction to other educators and to the pub- 
lic. The French have emerged from the Inquiry conducted up to the present “moie 
modest and less dogmatic” about the impeccability of their examinations 

The Scottish Committee addressed itself to a somewhat larger question within 
the scope of the Inquiry. Before the Inquiry was initiated the Scottish Council for 
Research in Education had already undertaken two inquiries into teachers’ esti- 
mates and the time devoted to examinations which were completed and published 
in 1932. Two new studies were undertaken, the one prospective, the other retro- 
spective. The prospective inquiry consisted of a mental survey of Scottish children, 
representing a complete age-group of 87,498 children or practically all the childien 
in Scottish schools born in 1921. The test used was Professor Godfrey Thomson’s 
Group Intelligence Test. Of the total group 1,000 children, constituting a repre- 
sentative sample of the whole age-group, were further tested by means of the Ter- 
man revision of the Binet-Simon scale. The results of this study were published in 
1933 under the title The Intelligence of Scottish Children: A National Swvey of an 
Age-Group. The Examinations Inquiry Committee decided to keep In touch with 
the thousand children who had been tested individually and to follow them up 
through their school careers and, if possible, beyond. Such a follow-up study, some- 
what similar to the Pennsylvania Study, will, it is hoped, result in discovering how 
far the promise at the age of eleven was fulfilled in their later careers 

The retrospective inquiry undertook to investigate the prognostic or predictive 
value of the examination for entrance to the university. The group investigated 
consisted of 472 students, men and women, who had entered one of the universities 
in 1928. The data available consisted of teachers’ and piincipals’ estimates, the 
marks obtained in the Leaving Certificate Examination, an external examination 
conducted under the auspices of the Scottish Education Depaitmcnt, marks given 
by professors in university class examinations, and marks obtained in the final ex- 
aminations for a degree, either ordinary or honours. Only a few of the results can 
be given here- the principals’ estimates were, on the whole, higher for those stu- 
dents who obtained honours than for those who did not, and were higher for stu- 
dents who obtained first class honoui's than for the second class honours, and so on. 
The composite marks in the Leaving Certificate Examination were in the same 
way predictive as between students who took honours or ordinary degrees. Finally, 
there was found a loiver correlation between teachers’ estimates and Leaving Cer- 
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tificate marks in certain subjects than between class and degree marks obtained in 
the university. The results of this study have also been published under the tdle, 
The Prognostic Value of University Entiaiire Eoeam’uiations in Scotland. Evidence 
of the interest in the two Scottish studies is indicated in the cooperation of every 
education authoiity and private school, the cential authoiity, and the university. 
It is hoped through these channels to influence public opinion on the one hand and 
to sec that no pupil of ability fails to receive the education appiopiiate for him. 

Of the German Committee only one representative attended to present the final 
reports of a scries of studies. As in Scotland a group of educators had already begun 
to investigate the pioblems of examinations before the International Inquiry was 
instituted. The study of these problems had been stimulated in the Geiman Repub- 
lic by the need of discoveimg some adequate methods of selection for admission to 
the secondary schools, on the one hand, and by the tendency of German youth to 
crowd into the universities in the intense struggle for economic survival Tlie prob- 
lems were as much sociological as they were technical. On the lechnical side I he 
investigations at the stage of admission to the secondary schools were dcvolcd to 
studies of the prognostic values of various methods of selection — toacdiers’ esti- 
mates, school marks, entrance examinations, psychological tests. 'I'lie general re- 
sults of a series of investigations conducted in Berlin by Bobertag and Ilylla and 
in Bremen by Valentiner produced a number of coneliisioiis wliieli had alrisidy 
been anticipated in similar studies in the United States. Teachers’ estiinati's were 
in general inconsistent, but might be improved somewhat by special courses to 
teachers, the prognostic value both of school marks and of marks in entrance ex- 
aminations was shght and unreliable; Intelligence tests bad a higher prognostic 
value than any other measure, and a combination of the three methods produced 
the best results. One investigation attempted to discover the qualities necessary 
for success in secondary education and resulted in the conclusion that intelligence 
was a more inipoi tant factor than social or emotional qualities. Another study on 
the marking of an essay, while it showed agreement among several examiners on 
the very best and the very worst, revealed great variation between these points 
All the studies have been published under the title Schuler auslese by O, Bobertag 

The sociological aspects were inherent in many of these studies and were the 
objects of one in particular Tliey constituted the main purpose of an investigation 
conducted by Dr. Robert Ulich and Dr. Erich Wohlfahrt, who undertook to show 
the relations between the social origin of students, the types of secondary schools 
selected, their professional aims, and their success in the courses undertaken. 
Social origin, as expressed in differences of cultural background, affected both selec- 
tion of schools and careers and educational success The general conclusion of tlic 
authors was, however, that there is no justification for the educational segregation 
of youth according to their social origin, and that from the national point of view 
methods must be devised whereby the ablest students of all classes, some stimulated 
by their cultural background and otheis by the will to rise socially, be selected to 
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pieserve the “hereditary culture carefully nursed and maintained for generations”, 
otherwise a nation is in danger of cultivating mediocrity The study further re- 
vealed, both from the sociological and educational points of view, that the differ- 
ent types of secondary school courses differ in quality and standards and that the 
same is true of different departments in the universities An analysis of examination 
results at the university level showed that the stricter selection was made in de- 
partments conducting fewer but more comprehensive examinations than in depart- 
ments with frequent examinations during the couise School records were found to 
be unreliable as prognostic measures of success in the university, satisfactoiy re- 
sults were attained by a combination of school lecoids and selection by expert com- 
mittees which took into account not only intellectual achievements as shown in 
school records but supplemented these by judgments on the whole personality of 
the candidates. An analysis of the investigations in this field undertaken under the 
auspices of the Siudienstiftmig des Deutscheu Volkes, an organization established 
after the War to provide help for highly gifted students The studies of the Stuclien- 
stiftung centered around the problems of overcrowding of students in the univer- 
sities and the liberal professions, the consequent competition and maladju.stnients, 
and the urgent need of adequate measures of selection and distribution of students. 
That these pioblems are just as pressing under the Nazi as under the Republican 
regime is indicated by the law of April, 1933, and subsequent decrees, and by an 
investigation undertaken by the Minister of Education m Saxony, published under 
the title Geist und Torheit auf Primanerbanken. 

The American educator may be tempted to ask what contribution can the studies 
and research cairied on in foreign countries make to the solution of his problems. 
On the technical side he may claim that he knows all that there is to know about 
the unreliability of the traditional examinations and tlieir maiking, he has m the 
mam passed the stage of inquiry reached by the foreign educators and has alieady 
made considerable progress in the development and elaboration of more or loss re- 
liable and valid substitutes, he has little to learn perhaps about the provision and 
organization of education because the ideal of equality of educational opportuni- 
ties has for long been the basis of the American system of education. And yet one 
may answer that our own problems become clearer in the light of the discoveiy of 
similar problems elsewheio The countries discussed in this article, and many other 
countries, are discovering that the crucial piobleni is not primarily one ofseleciioii 
but of the distribution of education according to aptitudes and abilities. Despite 
the great amount of work done on the technical side in the United States, one 
may hazaid the statement that it has not been guided by a thorough recognition of 
purposes The work m the United States has been influenced by a desire to dis- 
cover those studies by which an individual is best capable of profiting. The Euro- 
pean countries are just as much interested in this phase of the problem, hut as they 
dig deeper into it, they realize that over and above individual differences of apti- 
tudes and needs and urges the most important task still remains the definition and 
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preservation of educational values. The one solid contribution which comes out of 
the European inquiries is that the technical, psychological, statistical studios of 
examinations are as much concerned with the needs of society as of the individual, 
and that these studies must remain meaningless unless they are guided by a philos- 
ophy of educational values and purposes. 

The statement was made earlier that the problems here discussed are not new. 
They were recognized by Plato; in the seventeenth century in the infancy of mod- 
ern science the possibilities of applying scientific methods to the study of the 
human being were already envisioned. Bishop Thomas Sprat, the first historian of 
the Royal Society of London for the Improving of Natural Knowledge, after describ- 
ing what science might ultimately contribute to human welfare, wrote in 1667; 

In men, may be consider’d the Faculties, and operations of their Souls, The 
constitution of their Bodies, and the works oftheii Hands. Of these, the first they 
omit: both because the knowledge and direction of them have been before under- 
taken, by some Arts, on which they have no mind to intrench, as the Politicks, 
Moiality, and Oratory and also because the Reason, the Understanding, the 
Tempers, the Will, the Passions of Men, are so hard to be reduc’d to any ccr Lain 
observation of the senses; and afford so much room to the obsovers to falsi lie or 
counterfeit: that if such discourses should be once entei-taiii’d; they would bo In 
danger of falling into talking, insted of working, which they carefully avoid. Such 
subjects therefore as these, they have hitherto kept out. But yet, when they shall 
have made more progress, in material things, they will bo in a condition, of pro- 
nouncing more boldly on them too. For, though Man’s Soul, and Body are not 
onely one natural Engine (as some have thought) of whose motions of all soits, 
there may be as certain an accompt given, as of those of a Watch or Clock: yet 
by long studying of the Spirits, of the Bloud, of the Nour ishment, of the parts, 
of the Diseases, of the A dvantages, of the accidents which belong to humane bodies 
(all which will come within their Province) there, without question, be very near 
ghesses made, even at the more exalted, and immediate Actions of the Soul, and 
that too, without destroying its Spiritual and Immortal Being. 

And Socrates in his last hour faced his fate without flinching because “Above all, 
I shall be able to continue my search into true and false knowledge; as in this world, 
so also in that, I shall find out who is wise, and who pretends to be wise and is not.” 
(Jowett’s translation.) The question still remains whether, in the words of Bishop 
Sprat, in an inquiry into the immediate actions of Soul, this can be done “without 
destroying its Spiritual and Immortal Being,” or, in modern terms, whether the 
search for the right education for the right individual under the right teacher by 
old or new type examinations can be conducted without destroying educational 
values. 

It is at this point that the work of the Educational Records Bureau and the 
Cooperative Test Service derives its significance and meaning. This work is not an 
attempt to dilute standards or values, but, to the degree that measuring instru- 
ments have been perfected. It represents a genuine and sincere effort to discover 
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the leal aptitudes of the student as an individual and to carry him along the lines on 
■which he is test fitted to advance. It does not seek to discard educational values, 
but aims, so long as these are generally accepted, to develop them in their essential 
richness to the extent that a student can profit from them In so far as these efforts 
succeed, they will tend to reduce, and perhaps eventually to eliminate, much of the 
tragic waste which still exists in education. 

The acknowledged and proved existence of individual differences is frankly ac- 
cepted and a method is provided by which they can be met more effectively To 
accept as a principle that non omnia possumus omnes does not simplify the task of 
educators, but it places the onus where it belongs — on the recognition that one of 
the most serious responsibilities confronting educators today is that of guidance, 
which is possible only with the fullest knowledge over a long period of the poten- 
tialities of each individual to be educated. To the best of my knowledge neither 
the Educational Records Bureau nor the Cooperative Test Service nor other organ- 
izations engaged in similar work expect to answer all the problems of education; 
in the minds of enlightened leaders there is no suggestion that testing is a substi- 
tute for good teaching or that new type tests pronde a substitute for good teaching 
or that now type tests provide a substitute for the best in the old type, such as the 
essay. Nor does the work of such organizations seek to compromise witli educational 
values by positing some miracle of “’thinking” without the wherewithal with which 
to think, nor does it seek to set up a fallacious distinction between the “how” and 
the “what” of education, but recognizes that in true education these cannot be 
separated. No one would claim that this work provides the ultimate solution of all 
problems in education, but it is a step toward discovering an answer to many of the 
problems raised at the Conferences of the International Examinations Inquiry. 




INDEX 




INDEX 


jA-ccbediting, 104 f. 

Advisory Committee on College Testing, 121 
Aikm, W. M., 54, 133 
Alternative courses, 12, 14 f. 

American and European education, 5 ff. 
American Council on Education, 121, 126, 129, 
142, Psychological Examination, 96, 129, 132 
Ameiiean tiistoiical Association, 45 
American Philological Association, 45 
Amherst College, 36 
Analogies tests, 87 
Anderson, H. H,., 129 
Appel, F. S., 102 
Aptitude tests, S3 f. 

Autlimctic tests, 73 
Army Alpha Test, 95 
Army conscripts, examination of, 169 
Association for Education in Citizenship, 13 
Association of College Presidents in Pennsyl- 
vania, 134 

Association of Colleges and Secondary Schools 
of the Middle States and Maryland, 36 
Association tests, 97 

ISaocalaur^at, 89i report on, 153 f. 

Bagley, William C., 76 

Balfour, Sir Graham, 20, 159, 162 

Barnard, H., 24, 27 

Becker, Carl, 167 

Beers, F. S., 83 

Berechhgungen, 11 

Binet, 74 

Bobertag, O., 173 

Boston, examinations in, 22, 24 f. 

Boston University, 36 
Bovet, P., 168 
Briggs, T I-L, 10, 19 
Brigham, Carl C., 55 
Bioome, E. C., 23, 37 
Brown University, 36 
Brunschvieg, L6on, 16 
Buckingham, B. R., 71 
Burk, F., 71 
Burnet, Mr., 157 
Burns, C. Dehsle, 17, 167 
Butler, Nicholas Muiiay, 36, 44 

Caldwell, O. W , 24 if. 

Cainegie Coipnration of New York, vu f., xi, 
167 f 

Cainegie Foundation for the Advancement of 
Teaching, vn, 134 f., 168 


Carstater, E. A., 101 
Cattell, J. McKeen, 59, 73 f. 

Central Committee on Personnel Methods, 121 
Oertificat d' dtudes primaires, 171 
Chapin, Angie C., 58 
Chicago, University of, 103 f. 

Classification tests, 87 
Coffman, L. D., 103, 117 
College Aptitude Rating, 117 
College Cumulative Record Form, 145 f 
College Entrance Examination Board, 7, 36, 
43 ff., 59, 104, 130, 156 f. 

College Psychological Examination, 129 
College Sophomore Testing Piogram, 121 f. 
College success, prediction of, S3 f., 93 f., 106, 
116 

Columbia College, 95 
Colvin, Stephen S., 76 f. 

Comm, R , 63 

Commission on the Relation of School and Col- 
lege, 133 

Commission Permanents de Selection et Oi len- 
tation, 159 

Committee of Review, 45 
Committee of Revision, 45, 47, 33 
Committee of Ten, National Education Associa- 
tion, 37 

Committee on Educational Testing, 121 f. 
Committee on Examination Ratings, 46 
Committee on Uniform College Entrance Re- 
quirements, 37, 45 
Commonwealth Fund, 129 
Completion tests, 87 
Consultative Committee, England, 16 
Contemporary Civilization, course in, 90 
Cooperative Test Service, 122 ff., 126 ff., 131, 
174 f.; list of tests, 123 ff. 

Corrective work, testa and, 131 
Courtis, S, A , 24 ff 
Cowley, W. H., 73 
Coxe, W. W., 39 

Crawford, Margaret Elinor, case of, 146 ff. 
Credits, 12, 134 ff. 

Cross-out tests, 87 
Culture ginirale, 167 
Culture tests, general, 137 
Cullme, tradition of, 8, 11, 152 f. 

Cumulative record cards, 20, 133 f., 140 ff. 

Dartmouth College, 36 
Dearborn, W. F., 63 
Denmark, 158 
Desclos, A., 101 



INDEX 


180 

Deteiminism in tests, 76 
Diagnostic tests, 131 ff. 
Differentiation in education, 166 
Discipline, formal, 9 
Dispersion, 33 f. 

Distribution of education, 159 
Draper, Andrew S., 39 
Duffus, B. L., 12 


Eastbouhnu, Conference on Examinations, xi, 

3, 167 

Ecole unique, 14 
Edgeworth, F. Y., 34 f. 

Education and examinations, 151 ff. 

Education, common problems of, 13 f. 

Educational guidance, 133, 140 ff., 143 ff. 

Educational Records Bureau, 124, 130 ff., 174 f. 

EinheitsachuU, 14 

Eliot, Charles W., 30 ff., 37 f., 162 

Elite, selection of, 167 

Elliott, E. C., 61 f 

England, examination inquiry in, 169 f. 
England, secondary education in, 11 f , 14 
English, examination experiment in, 61 f 
Enrollments, increasing, and tests, 93 f. 
Equality of opportunity, 70, 124 f., 144 
Essay examination, 85, 101 f.i marking of, 66 f. 
Emicli, A. C., 103 f. 

European and Amevican education, 5 ff. 
European education, aims of, 173 
Examination boards, 36 ff 
Examinations, College Entrance Board, 43 ff. 
Examinations, Conference on, xi, 3, 167 ff. 
Examinations, criticism of, 57 ff., external, 104ff., 
156; issues in, 170, purpose of, 70; reliabdity 
of, 158; reports on, 154, scientific attack on, 
69 ff.; social setting and, 3 ff i and education, 
5, 151 ff.; traditional, 22 ff.; value of, 57 ff , 
66; written, 37 

Examinations, Regents’, 37 ff. 


Tailuiies, 89; in education, 70 ff., 89; problems 
of, 15 

Farrand, Livingston, 74 

Fees in secondary schools, 15 

Emkelstein, I. E., 63 

Eiske, John, 89 

Eiske, Thomas S., 48 

Flexner, Abraham, 151, 153 

Fluctuations in examination results, 49 ff. 

Folkestone, Conference on Examinations, 169 

Formal discipline, 9 

France, examination inquiiy in, 170 f. 

Frutchey, F. P., 99 


Galton, Sir Francis, 73 f. 

Gales, A. 1 , 93 

General College, Univcisity of Minnesota, 100 f , 
117 ff. 

General Education Board, 136 
Gentile, 159 

Geomehy, examination experiment in, 62 
Germany, examination inquiiy in, 172 
Germany, secondaiy education in, 11 
Goddard, H. H., 74 
Godley, A. T., 28 
Grading, reliability of, 61 ff. 

Grixzell, E. D., 24 

Guidance, 20, 159 f.; educational, 133, 140 ff. 

Hadi.ev, Arthur T., 58 
Haggeity, M. E., 100 
Hancock, W. K., 18 
Uandwt ztinff Scale, 75 
Hairus, J Rcndell, 33 f. 

Hartnacke, W., 16, 19, 73, 158 

Hal tog. Sir Philip, 4, 19, 169 

Harvard College entrance examination, 33 

Hawkes, H. li., 91 

Elenmon, V. C., 1 13 

High school, meaning of, 10 

Hildreth, G., 93 

Elistory, examination experiment in, 03 

Hitler, 15 

Holt, F. O., 113 

Hopkins, L T , 51 

Hylla, E., 172 

Indupendent schools, 130 
Individual differences, 9 
Information, tests of, 83 f. 

Intelligence quotients, 20 
Intelligence tests, 54, 135 f. 

International coinpaiative studies, 133 
International Examinations Inquiry, 19 f., 165 ff. 
International Institute, Teachers College, Co- 
lumbia University, vii, ix, xi, 167 
Interview, method of, 170 f. 

Iowa Every-Pupil Achievement Testing Pro- 
gram, 109 f 

Iowa Silent Reading Test, 133 
Iowa statewide examinations, 109 f. 

Iowa, University of, 109 f. 

Italy, 169 

Japan, 159 
Jessup, Walter A., xi 
Johnson, P. O., 102 
Johnston, J. B., 117, 119 f. 

Jones, E. S., 121 
Judd, C. H., 168 



INDEX 181 


Kandel, I. L., vii f., 3, 5 , 8 f., 11, 16, 37, 69, 
104, 144, 158 
Kelly, F. J , 64 

Kent Education Committee, 145 
Keppel, Fiedenck P., ix, xi 
Kilpatiick, W. H., 81 
Knight, Edgar W., 144 
Knowledge, meie, and tests, 138 
Knox, W. W., 37, 57 
Koos, L. V , 10 
Kotschmg, W., 153 
Kiey, A. C., 102 

Lano, a R., 87 

Lapie, P., 7 

League of Nations’ Mission of Educational Ex- 
perts, 12 

Learned, William S., vn, xii, 5, 83, 134 f., 138, 
140 

Leaving Ceitificate Examination, 171 f 
Leicester, examinations in, 24 
Lindquist, E. F., 110, 129 
Locke, John, 161 f. 

Lowell, A. Lawience, 82 
Lowell, examinations in, 24 

MacGbegor, G , 134 
MaoLean, M. S., 84 
McCall, W. A., 87 
McConn, Max, 91, 129, 138 f., 144 
Maine, University of, 36 
Mann, C. R., 91 
Mann, Horace, 24 f., 28 
Maiks, vai lability of, 62 f. 

Massachusetts, examinations m, 22 
Matching tests, 87 

Methods, statistical, in education, 160 f 
Meyer, Max, 63 

Minnesota statewide examinations, 115 if 
Minnesota, University of, 92, 100 if. 

Modern Language Association, 45 
Monroe, Paul, viii f , xi, 167 
Monioe, W. S,, 66, 87 
Monzie, Anatole de, 159 
Moiison, S. E., 23 
Morrison, Henry C , 72 
Mount Holyoke College, 36 
Mulhern, J., 24, 28 
Multiple-Choice tests, 87 
Multiple-Response tests, 87 

Nai'iuxal Bureau of Selection and Guidance, 
89 

National Education Association, committees of, 
37, 45 


National Research Council, 129, 145 
National Society for the Study of Education, 7 4 
Nationwide testing progiams, 120 If 
Nelson-Denny Reading Test, 1.32 
New Education Fellowship, International Com- 
mission, 145 

New England Association of Colleges and Pie- 
paratory Schools, 36 

NewEnglandCollegeEntiance Certificate Board, 
35 f. 

New England Colleges, Confeience of, 36 
New Type tests, 39 ff , 79 If., 135 f., 140 f., 160 f. 
New Yoik State Regents' Examinations, 37 If., 
95, 104 

Nichols, E PL, 58 
Normal cmve, 69 
Norms, use of, 131 
North Central Association, 61 
Noithein Univeisities Joint Matriculation 
Board, 7, 11, 157 
Norway, 158 

OniEca'iVE tests, 39 if., 79 if., 1.35 f., 140 f , 160f, 
Odell, C. W , 65, 87 

Ohio College Association Intelligence Test, 106 
Ohio statewide examinations, 105 f. 

Orata, P., 9 
Otis tests, 132 

Oxford and Cambiidge Schools Examination 
Boaid, 157 

Iamieb, F., Jr., 72 
Paterson, D O , 88 
Patterson, B. F., 28 

Pennsylvania College Achievement Test, 122 
Pennsylvania State Department of Public In- 
struction, 134 

Pennsylvania Study, vu f , 133 if., 1 46 
Philadelphia Academy, 23 
Pintner-Cuiinmgham Primaiy Mental Tests, 
132 

Plainer, R., 74 f. 

Plan A, College Entrance Examination Board, 
53 

Plan B, College Entrance Examination Board, 
53 

Plato, I6I, Uio, 171 
Points, 12 

Poitsmoutb, examinations m, 21 
Poweis, S R., 133 

Predictability, criteria of, 95 ft., 106, 116 
Prediction of college success, 53 f., 95 f., 106, 116 
Futchett, Henry S , vii 
Private schools, 130 
Piogiessive Achievement Tests, 132 
Piogressive Education Association, Commission 
on the Relation of School and College, 133 



INDEX 


182 

Prospective inquiiy and examinations, ll'l 
Public and education, 9 
Pupil’s Record Card, Kent, 145 
Pupils, selection of, 172 

Quality m education, 131 f. 

Quantitative measures in education, 134 ff. 
Questions, preparation of examination, 40 f. 
Quincy, J., 23 

Rauheniieimeb, A. S., 98 
Reasoning and tests, 83 f. 

Recall tests, 87 
Recognition tests, 87 
Record card, cumulative, 135 f. 

Reeves, W. F., 96 
Regents’ Examinations, New York State, 37 ff., 
95, 104 

Reifepi ufu/ng, 158 

Reliability of marking examinations, 51, 61 ff., 
158 

Remedial work, tests and, 131 

Retrospective inquiiy and examinations, 171 f. 

Rhodes, E. C., 4, 19 

Rice, J. M , 75 

Richardson, H. D., 10 f. 

Ruch, G. M., 64, 87 
Russell, C., 87 
Russell, J. D , 96, 104 
Russia, 159 

Sadleh, Sir Michael, 168 
Salem, examinations in, 24 
Sanctions, 11 
Sandiford, Peter, 64, 78 
Savage, Floward J., xii 
Scholarships, national, 171 
Scholastic aptitude tests, 54, 56 f. 

Scientific attack on examinations, 69 ff. 
Scientific movement in education, 57 f., 73 f. 
Scotland, examination inquiry in, 169, 171 f. 
Scottish Council for Research in Education, 
168 f. 

Secondary and I-Iigher Education in Pennsyl- 
vania, Study of, 133 ff. 

Secondary education, ineanmg of, 10 
Secondary School and College Cumulative Rec- 
ord Forms, 143 f. 

Secondary Schools Examinations Council, 154 
Segel, D., 105, 107, 131 
Selection, 153; methods of, 19 f. 

Similarities tests, 87 
Simon, 74 

Smallwood, M. L., 33 
Smith College, 36 


Smith, John Moiton, Jv , case of, 148 f 

Social justice and education, 167 

Social setting and examination.s, Ch. I 

Social studies, 13 

Sociates, 106, 174 

Spender, J. A., 8 

Sprat, Thomas, 174 

Slalnaker, J. M., 66 f , 104 

Stalnaker, R. C., 66 f. 

Standardizing agencies, 104 
Standards in education, 8, 114 
Starch, D., 61 ff., 65 
Statewide testmg programs, 104 ff. 

Stone, As ithmetic Tests, 7 5 
Stiang, R , 93, 95 ff., 150 
Stieeter, Superintendent, 37 
Students, scholaiship, 173 
Success, college, picdiction of, 53 f., 95 f., 106, 
116 

Suzzallo, H., 33 
Sweden, 158 

Switzerland, examination inquiry in, 168 f. 
Symonds, P M., 87, 93 

IcACHnHs, secondary scliool, 13 
Testing pi ograms, nationwide, 130 ff., statewide, 
104 ff. 

Tests, 30; and instruction, 86, 127, 133; and meie 
knowledge, 138; and reasoning, 83 f.; apti- 
tude, 53 f.; Army, 75 f.; constricting influence 
of, 137 {., 133; newtype, 79 ff.; objective, 79 ff , 
160; production of, 138; use of, 131 
Thomson, Godfiey, 171 

Thorndilre College Enhance Examination, 95 f. 

Thorndike, E. L , 10, 59 ff., 74 f , 78 ff„ 168 

Thuistone, L. L., 104, 139 

Thurstone, Thelma G., 139 

Tildsley, John L., 11, 144 

Toops, H. A., 105 

Touton, F. C., 98 

Tradition, American, 166 

Tradition, the Great, 153 

Traxler, A. E., 68, 83 

Tufts College, 36 

Tyler, R. W., 83, 99 

TJlicii, R., 173 

United States, aim of education, 173; character- 
istics of education in, 153 
United States and Europe, educational systems 
of, 5 ff . 

Units, 13 

A^LENriHE, C. W., 19, 158 
Validity of education, 153 



INDEX 


183 


Variability, 12<1, 13T f.; of maiks, 62 f 
Veiiiiont, University of, 36 
Vittoiino da Feltre, 153 f. 

WEAvrn, R. B., 68, 82 
Weidemann, C. C., 85 
Wellesley College, 36 
Wesley, R. R., 102 
Wesleyan University, 36 
Wesson, R. R., 102 
West Riding of Yorkshire, 12, 15 
Whitciaft, L. H., 57 
White, E. E., 28 f. 

Whitman, A. D., 53 


Williams College, 36 

Williamson, E O., 117, 119 

Wisconsin statewide examinations, 112 ff. 

WohlfahH, E., 16, 19, 73, 158, 172 

Wood, Ben D., xii, 39 IT., 64 f., 71, 77, 82, 87, 90. 

95, 99 f., 127, 135, 145 
Woodwaid, W. II., 153 
Wylie, A. T , 74 

'K.le College, examinations in, 23 
Yerkes, R. M., 76 
Yoakum, C. S., 76 

Zook, G. F., 120 



